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ABSTRACT 


The marginal utility of the Turing machine computational resources 
running time and storage space are studied. A technique is developed 
which, unlike diagonalization, applies equally well to nondeterministic 
and deterministic automata. For f, g time or space bounding functions 
with f(n+l) small compared to g({n), it is shown that, in terms of word 
length n, there are languages which are accepted by Turing machines 
operating within time or space g(n) but which are accepted by no Turing 
machine operating within time or space f(n). The proof involves use of 
the recursion theorem together with "padding" or "translational". tech- 
niques of formal language theory. 

Relations between worktape alphabet size, number of worktape heads, 
number of input heads, and Turing machine storage space are established. 
Within every common subexponential space bound, it is shown that enlarg- 
ing the worktape alphabet always increases computing power. A hierarchy 
of two-way multihead finite automata is obtained even in the nondetermi- 
nistic case. 

Results that are only slightly weaker are obtained for Turing 
machines that accept only languages over a one-letter alphabet. 
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CHAPTER ONE 


INTRODUCTION 


The ultimate purpose of studies in computational complexity is to 
establish the complexity, in terms of Scmpitaktonal resources such as 
time and storage space, that is inherent in particular computational 
tasks. The existence of computational tasks with various inherent com- 
plexities is the subject of this thesis. The mere existence of such 
computational tasks does not, a priori, have a bearing on the complexity 
of computational tasks of practical interest; but in fact eacnhiaues 
such as those of Meyer and Stockaever {MS72], Meyer [Mey73], Stockmeyer 
and Meyer [SM73], Hunt [Hun73], M. Fischer and Rabin [FR74], and 
Stockmeyer [St74] sometimes show that a particular task of interest lies 
at some level if anything does, and results like ours can then serve. 

The computational chek that we consider are "language acceptance" 
tasks. A language is a set of strings. of symbols from some finite | 
alphabet. A language is accepted by a computer M if M enters an accept- 
ing state when and only ier applied to a member of the language. We 
denote by L(M) the Language accepted by M. 

Turing machines are the computer model we use. Customarily, we 
measure time and space usage by a Turing acceptor in terms of input 
length only. (We denote by | xx| the length of the string x.) The Turing 
machine M accepts L(M) within time T(n) or space S(n) if each string 
x € L(M) is accepted in some computation involving no more than T(|x|) 
steps or S(|x|) worktape squares, respectively. (More precise defini- 


tions appear in Chapters Two and Three.) We denote by NTIME(T) and 


DTIME(T) the classes of languages accepted within time T by nondetermi- 
nistic and deterministic Turing machines, respectively; and we denote by 
NSPACE(S) and DSPACE(S) the classes of languages accepted within space S 
by nondeterministic and deterministic Turing machines, respectively. 

We would like, for example, to define the inherent deterministic 
time complexity of accepting a language L - be the "least" time bound T, 
in some sense, such that L € DTIME(T). The existence of languages which 
have no best acceptor (languages with "speed-up" [Blm67]), however, 
makes such an approach impossible. Instead, we content ourselves to- 
specify pairs of time bounds T> Ty for which L € DTIME(T,) - DTIME(T,)- 
In effect, then, we are led toa study of the containment lattice of the 
complexity classes. For example we address ourselves to the problems of 
finding what we call "containment" and "separation" conditions on time 


bounds T,, T, which imply that DTIME(T,) c DTIME(T.) and that — 


2 
DTIME(T,) - DTIME(T, ) x ¢ (i. e., DTIME(T,) d¢ DTIME(T,)), respectively. 
Rather strong separation results for the DTIME and DSPACE complexity 
classes are well known ({Has65}, [HeS66], [SHL65], [HU69a], [HU69b], 
[Con73], Appendix I of this thesis), but the diagonalization technique 
that most of them rely on does not give very strong separation results 
for the NTIME and NSPACE classes. A result of Cook [Ck73] first sepa- 
rated NTIME(n*) from NTIME(n*) for r # s. Our contribution is a simpli- 
fied and greatly generalized version of Cook's technique that applies to 
nondeterministic and deterministic time and space complexity. 


The major value of our technique is for nondeterministic computa- 


tion, and the results are most dramatic at exponential and subexponential 


complexity levels. Although no real computer actually operates nonde- 
terministically, the concept does arise naturally in connection with 
formal language theory ([HU69b], [AU72], [AU73]}), proof theory, and the 
description and complexity of other processes involving arbitrary 
searches [F167]. (A deterministic description would force one to specify 
the essentially irrelevant details of some arbitrary search algorithm.) 
The Cook-Karp question of whether P = NP, where 

P =\) { DTIME(T)| T is a polynomial time bound}, 

NP =() {NTIME(F)| T is a polynomial time bound}, 
represents a mathematical formulation of the problem of characterizing 
the complexity of a large class of combinatorial optimization problems 
involving such unstructured searches ([Ck/1], [Krp72]). 

We first generalize Cook's technique for multitape Turing machine 
time complexity in Chapter Two. For well-behaved Ty. we show that 
NTIME(T,) - NTIME(T, ) # @ whenever T, (n+l) € o(T,(n)) ,* for example. 
Surprisingly, this yields some specific separation results for NTIME 
which are stronger than the corresponding know separation results for 
DTIME. In contrast, the earlier results based on diagonalization were 
always stronger for DTIME than for NTIME. Separation results with re- 
spect to languages over a one-letter alphabet are obtained that are only 
Slightly weaker than the general ones. 

In Chapter Three we refine the NSPACE and DSPACE complexity classes 

For g a nonnegative real-valued function on N (the set of all non- 
negative integers), we use the notation o(g) (O0(g), respectively) for 
the class of all nonnegative real-valued functions f on N that satisfy 


lim (f(n)/g(n)) = 0 (lim sup (f(n)/g(n)) <o, respectively) as n tends 
to infinity. 


by carefully bounding worktape alphabet size and number of worktape 
heads. We reformulate the known separation results for these classes 
and apply our technique to get new ones of the kind given above for 
NTIME. By relating the various resources (space, worktape alphabet size, 
number of worktape heads), we obtain separation results that focus on 
the marginal utility of each resource. As a corollary we. get a hierar- 
chy theorem for two-way multihead finite automata. As in Chapter Two, 
only slightly weaker separation results are obtained with respect to 
languages over a one-letter alphabet. 

A preliminary version of this thesis has been reported jointly with 
M. Fischer and A. Meyer [SFM/3]. In particular, Corollaries 14, 16 of 
Chapter Two were obtained and reported jointly. Chapter Three contains 
much new material, but Corollaries. 19(iii), 20(1ii), 22 were also pre- 
sented in the preliminary version. Problems 2, 3, 4 of [SFM/3] are set- 
tled affirmatively by the current results of Chapters Two and Three. 

For convenient reference we now list. the results which are the main 
contributions of this thesis. All. of the relevant definitions and nota- 


tion are provided in Chapters Two and Three. 


Chapter Two 


Assume Ty is a running time. 
The most general result we prove is Theorem 13. 
Theorem 13. 
NTIME(T,) -U {NTIME(T,)| there is some recursively bounded but strictly 


increasing function f:N + N for which 


T, (£(@m+1)) € 0(T,(£(n)))} 


contains a language over {0,1}. 


In practice it is the simpler but only slightly less general Corol- 
lary 14 that we emphasize. (For nondecreasing time bounds the result is 
no weaker than Theorem 13.) 

Corollary 14. NTIME(T,) - U {NTIME(T, }| T, (a1) € o(T,(n))} 


contains a language over {0,1}. 


Corollary 14 gives results that diagonalization does not give pre- 
cisely when log T, (ntl) = o(T,(n))- Corollary 15 is a refinement that 
gives new results even when log T, (n+l) € O(T,(n)). 

Corollary 15. 
NTIME(T,) - U {NTIME(T,)| T,(n+1) € 0(T,(n)), T,(n) € 0(T,(n))} 


contains a language over {0,1}. 


For deterministic time complexity, we prove a version of Corollary 
14 that has an additional hypothesis. 
Theorem 16. Suppose that there is some fixed k such that for each de- 
terministic IM acceptor M there is a deterministic k-tape TM acceptor M' 
and a constant ce such that L(M') = L(M) and Time, , (x) < c-f(Time,,(x)). 


Then DTIME(T,) - U {DTIME(T,)| £(T,(n+1)) € o(T,(n))} # @- 


When we restrict our attention to languages over a one-letter 
alphabet, we still get Theorem 17. 
Theorem 17. If f is real-time countable, then 

NTIME(T,) - U { NTIME(T, )| T, (at! eo! (n)) € o(T,(n))} 


contains a language over {1}. 
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Chapter Three 


Containment: 


First we relate worktape alphabet size to storage space. 
Proposition 3. NSPACE(S,m,f¢) C NSPACE(S‘,m',£) 


if S(n)/S'(n) <§ < log m' for some rational §. Similarly for DSPACE. 


The next two results relate the number of worktape heads to (the 
logarithm of) storage space. 
Proposition 4. NSPACE(S, m, £+k) C NSPACE(S+{k+1+¢) log S, m, £) 
for every ¢ > 0. Similarly for DSPACE. - 
Proposition 5. NSPACE(S + kelog | S, m, £) C NSPACE(S, m, £+k+3). 


Similarly for DSPACE. 


Later on we relate multihead finite automata to logarithmic storage 
space. 
Lemma 21. NHEADS(k) C NSPACE(log, n, 2" 1) Cc NHEADS(Kk+4). 


Similarly for DHEADS, DSPACE. 
Separation: 


Theorems 18 and 25 are somewhat analogous to Corollary 14 and 
Theorem 17 of Chapter Two, especially in proof. 
Theorem 18. NSPACE(S,,m,£+3) - U {NSPACE(S, ,m,£+2)| 1 € 0(S,(n)-S, (nt1))} 
contains a language over {0,1} if S, is fully constructable by an (m,£)- 
machine. Similarly for DSPACE. 
Theorem 26. 
NSPACE(S,.m,£+6) - U {NSPACE(S, ,m,4)| Sy (n)-S, (n+£(n)) 2 4+log n} 


contains a language over just {1} 


il 


if So is fully constructable by an (m,£+2)-machine, 
log n € 0(S,(n)), 


f(n) € O(n) - O(1) is nondecreasing and linear space honest. 


Similarly for DSPACE. 


Unlike Theorem 25, Theorem 27 applies even for logarithmic space 
bounds. 
Theorem 27. NSPACE(S,,2,£+1) - U {NSPACE(S, ,2,2£)| 1 € 0(S,(n)-8, (2n)) } 
contains a language over just {1} 
if So is fully constructable by a (2,)-machine, 
1 € 0(S)(n) - log, n), 


Le 3. 
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CHAPTER TWO 


TIME SEPARATION THEOREMS FOR , 


NONDETERMINISTIC MULTITAPE TURING MACHINES 


In this chapter we refer to what is usually called sanedereaunie: 
tic multitape Turing machine [HU69b] simply as a TM, and we refer to its 
deterministic version as a deterministic TM. If such an automaton has - 
tapes (each with a single read-write head), then we call it a k-tape ™ 
or a deterministic k-tape T™, respectively. “We often let a TM receive 
an input, a finite string of symbols from some finite input alphabet E> 
initially written to the right of the head on tape 1, the worktape which 
we call the input tape. A TM can act as an acceptor by halting in some 
specified accepting state at the end of some computations. We assume 
the reader is familiar with how concepts such as these can be formalized. 
A good single reference for formal definitions relating to Turing machines 


is [HU69b]. 


Definition. Let M be any TM acceptor. M accepts the string x € z, 
where is the set of all finite strings of symbols from st if there 
is some accepting computation by M on input x. M accepts the language 
L(M) = {x| M accepts string x}. For x € L(M), Time, (x) is the number of 


steps in the shortest accepting computation by M on x; for x ¢ L(M), 
aay “Ret STEREO 


* 
We use the Kleene star more generally as well, along with other 


regular expression notation for regular sets. For A, BC x, 
A+B=AU B= fx] x € A or x € B}, 
AeB = AB = [xy] x € A, y € B}, 
* : 2 3 
A ={A} +A + AcA + AcAcA tees =fA} +A+H+A +A + eee, 


where ) is the null or empty string. When it causes no ambiguity, we 
sometimes omit set brackets in regular expressions. 
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Time,, (x) =o. 


Definition. A time bound is a function T:N +N with T(n) 2 n for every 
n. For T a time bound, the T-cutoff of the TM M is the Language 

LM) = {x| Time, (x) < T(|x|}}, which is always a subset of L(M). A 
language L is in NTIME(T) iff L = L(M) = L,.@™ for some TM acceptor M. 
Similarly, if M is deterministic and L = L(M) = L,.(M) » then L is in 


DTIME(T). If L(M) = L,.@) » then we say that M accepts within time T. 


Other, slightly different, definitions of the NTIME and DTIME con- 

: plexity classes have been proposed. Book, Greibach, and Wegbreit [BGW70], 
for example, say that-M accepts within time T only if every accepting 
computation on input x. € L(M) reaches the accepting state within T(|x|) 
steps. Such differences do not affect the complexity classes determined 
by time bounds of the following type, however; and time bounds of prac- 


tical interest are of this type. 


* 
Definition. If M is a deterministic TM acceptor with L(M) = 1 and 
Time, (x) = T(|x|) = |x], then T is a running time, and M is a clock for 


T. 


Diagonalization is the best known technique for obtaining separation 
or "hierarchy" results among the NTIME and DTIME complexity classes. A 
summary of the best separation results that have been proved by diago- 
nalization alone is given by the following pair of theorems. (See 


Appendix I, [HaS65], [HeS66], [Con73].) 


Theorem 1. If T, is a running time, then each of the following set dif- 


2 


ferences contains a language over f0,1}: 
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DTIME(T,) - U {DTIME(T, )| T, € O(T, log T,)}, 
NTIME(T,) - U { DTIME(T, )| T, ¢ O(T,)}, 


DTIME(T,) - UJ {NTIME(T,)| log T, ¢ o(1,)}-" 


Theorem 2. If T, is a running time, then each of the following set dif- 


2 
ferences contains a language over {1}: 
DTIME(T,) - U {DTIME(T, )| T, log Ty € o(T,)}> 
NTIME(T,) - U {DTIME(T,)| T, € o(T,)}, 


DTIME(T,) -U {NTIME(T, )| T, € o(log ot oi 


Remark. By restricting the unions of Theorem 2 to range only over aime 
ning times Ty» we can use the diagonalization technique of [MM71] to 
show that each of the following set differences contains a Language over 
{1} if T, is a running time: | 
DTIME(T,) -U {DTIME(T,)| T, is a running time, T, ¢ o(T, lee T,)}5 
NTIME(T,) - U {DTIME(T,)| T, is a running time, T, ¢ o(T,)}, 


DTIME(T,) -U {NTIME(T, )| Ty, is a running time, log T, 4 O(T,)}. 


_ Note the relatively poor results obtained in diagonalizing over 
NTIME. “Not even the gross separation result NTIME(n7) g uma), for 
example, follows directly from Theorem 1; yet, DTTME(n“*) G 
DTIME(n“(1og n)7) does follow. Recently, hioweders Cook [Ck73] eoued 


the following result by a new technique. 
Theorem 3. NTIME(n*) g NTIME(n®) whenever 1 < r<s. 


In this chapter we pursue Cook's technical breakthrough, simplifying his 


tWwhen the precise specification of a time bound is not relevant in 
some context, we allow an imprecise specification. Thus, in the context. 
of the "o" and "0" notations, the base and rounding for the logarithms 
in Theorems 1, 2 make no difference. (See also Lemma 7 below.) 
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proof and generalizing the result. The main generalization is Theorem 13 
below. We turn now to some lemmas that will be useful in the proof of 
that theorem and its corollaries. 

P. Fischer, Meyer, and Rosenberg [FMR72] have shown that every T™ 
with many heads per tape can be simulated without time loss by a T™ with 
only one head on each of some greater number of tapes. This allows a IM 
to carry out two computations at the same time, leading to proofs of the 


following lemmas. 


Lemma 4. L(M) U L(M') can be accepted in time min{ Time, (x) ,Time,, (x) }. 


Lemma 5. L() M L(M') can be accepted in time max{ Time, (x) ,Time,,, (x) }. 


Proof Bestohen, Combine M and M' by providing a second head on the 
first tape of each and a new input tape with a single head. Use the ex- 
tra heads to copy the input bie at full speed from the new input tape 
onto the two old input tapes. Meanwhile the remaining heads can be used 
to carry out computations by M and M' on the respective transcribed cop- 
ies of the input string, even while they are still being transcribed 


from the real input tape. 
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Rew tape 


\ 
(read-only) 


head 
tape 1 of M tape 1 of M' 
f fo | i ft 
new new 
(write-only) (write-only) 
head head 
tape 2 of M tape 2 of M' 
e ° 
last tape of M last tape of M' 
a Pe oe 
tapes of M tapes of M' 


To accept L(M) U L(M'), the composite machine enters its accepting state 
when the computation by either M or M' does. To accept L(M) Q L(M'), 
the composite machine enters its accepting state when computations by 
both M and M‘ do. Thus we have described multihead multitape Turing 
machines that accept L(M) U L(M') and L(M) M L(M') in the desired times. 
By the result of [FMR72], these can be simulated without time loss by 


multitape Turing machines with only one head per tape. 0 
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The same technique leads to a proof of the ‘Aext lemma,’ ‘in which a single 
T™ carries out computations by M and a clotk ‘for’ T simultaneously, 


accepting if M accepts before time T runs out. 


Lemma 6. If M is a ™ acceptor and T is a running time, then 


L,.() € NTIME(T). 


The next lemma indicates that the NTIME complexity classes depend 
only on growth rates. It also shows that we need at least the condition 
T, 4 o(T,) to be able to prove NTIME(T,) : NTIME(T,) # ¢. It follows by 
Theorem 1 that, if (cautery. 66 most people's intuition) DTIME(T) = 
NTIME(T) for all T, then NTIME(T,) - NTIME(T}) ‘= DTIME(T,) - DTIME(T,) 
is nonempty precisely when the running time J, is a member of the com- 


plement of O(T,)- 
Lema 7. If T, € O(T,), then NTIME(T,) © NTIME(T,). 


Proof sketch. For T, (m) (1+e)n for some ¢ > 0, this is just the linear 
time speedup theorem of Hartmanis and Stearns [HaS65]. The idea is to 
increase the size of each TM's work tape alphabet so that several steps 
can be performed in one big step. 

That the lemma holds for arbitrary Ty (n) 2 n has been observed by 
Book and Greibach [BG70]. The key idea is to use nondeterminism to guess 


the entire input string before it is read. [J 


The following lemma, due to Book, Greibach, and Wegbreit {BGW70], 
indicates that for nondeterministic time complexity we can get by with 
Ts having a fixed number of tapes. No similar result is known for de- 


terministic TMs. 


18 


Lemma 8. For each TM M there is a 2-tape TM M' and a constant c such 


that L(M') = L(M) and Time,,, (x) < ce Time, (x) for every x € L™. 


Proof sketch. If M has k tapes, then the "display" of a configuration 
of M will be a (k+1)-tuple consisting of the control state and the k 
tape symbols scanned in that configuration. The display of a configura- 
tion determines which actions are legal as the next move and whether the 
conék guration is an accepting one. The first task for M' is to nonde-- 
terministically guess an alternating. sequence of displays and legal ac- 
tions by M. The question of whether the sequence describes a legal com- 
putation by M on the supplied input is just the question of whether the 
symbols eetusity scanned on each tape when the actions are taken agree 
with the guessed displays. This can be checked independently for each 
tape in turn by letting the first tape of M' play the role of the tape 
while running through the guessed sequence of displays and actions. 
Clearly M' runs for time proportional to the length of the sequence it 


guesses. For further details, the reader is referred to [BGW/0]. J 


Lemma 9. For no recursive time bound T does NTIME(T) contain all the 


recursive languages over {1}. 


Proof. Each recursive time bound lies below some running time Ty> and 


Ty 


Theorem 2 gives a recursive language over {1} in DTTME (27 )- 


NTIME(T,). 0 


Tan idea of [BG/0] allows us to take c = 1 if we settle for a 3-. 
tape TIM M'. (See Lemma 7.) Aanderaa [Aan74] has shown that we cannot 
get by with c=#1 in the deterministic case no matter what fixed number of 
tapes we allow M' to have. (His counterexample is provided by determi-_ 
nistic TMs which accept in “real time" (Time, (x) = |x]).) 
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Like Cook's proof of Theorem 3, our proof of Theorem 13 makes cru- 
cial use of a trick called "padding." Acceptance time is measured as a 
function of input length; so if we can increase the lengths of the 
strings in a language L without significantly changing the time needed 
to accept the strings, then we get a padded language L' that is less 
complex than L as we measure complexity relative to input. length. One 
way to pad the Language L to L' is to take 

L' = p(L) = {xl0“| x €L, |x10"| = p({x|)} 


for some p:N * N with p(n) > n. 


Lemma 10. If p(n) >n is a running time, then 
p(L) € NTIME(T) @ L € NTIME(T op), 


where T op(n) = T(p(n)). 


Proof. (=) Suppose My accepts p(L) within time T. Design M, to pad its 
input string x (which is found at. the read-write head on the first work- 
tape) out to x10*, where | x10"| = p(|x|), and then to compute on input 
«10° according to the transition rules of My: Because p is a running 
time, the padding can be done in time p(|x|) by using an extra head on 
tape 1. A third head can be used for the computation by M, on input 


«10%. Clearly, then, M accepts L within time p(n) + T(p(n)) < 2*T(p(n)). 


2 
But NTIME(2¢T(p(n))) C NTIME(T(p(n))), by Lemma 7. 

(«) Suppose My accepts L within time T(p(n)). Design M, to check 
that its input string is of the form x10", where | x10"| = p(|x|), and 
then to behave like My on input x. Clearly M, accepts p(L) within time 
proportional to T(length of input to My); as required. 7 


The following lemma shows how padding may be used to derive separa- 
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tion results. Ruby and P. Fischer [RF65] first used essentially this 
technique in connection with the deterministic time complexity of se- 
quence generation, and Ibarra [Ib/72] used it more explicitly in connec- 
tion with the nondeterministic space complexity of language acceptance. 
(See Chapter Three of this thesis.) Ibarra has used similar techniques 


in other contexts as well ([Ib73a], [Ib/3b], [1S73]). 


Lemma 11. Let sets 84> 85 of time bounds be given. Say P, (2) a ere 
Pp, (n) > mn are running times with Ty ° Pyay € O(T, © P,) whenever 
lsic< 4, Ty € Sy? Ty € 85: 

IEF LEN {NTIME(T, o p,)| T, €8,} - U {NTIME(T, o p,)| T, € 8,3, 


then p,(L) € A {NTIME(T,)| Ty € 8.) - U {NTIME(T,)| T, €8,} for some i. 


Proof. For 1<i< 4, let 
C(i,1) =U {NTIME(T, op,)| T, € $3; 
c(i,2) =N {NTIME(T, o p,)| Ty € 85}- 
Suppose L € C(g,2) - C(1,1). By Lemma 7, NTIME(T, op; 44) C NTIME(T, © p;) 


whenever 1s i< £, T, € 84> Ty € 85; so, forlsic< g, 


1 
L € C(it+l,1) = L € C(i,2). 
If we were to have also 
L € C(i,2) => L € C(i,1) 
for every i, then we would conclude from L € C(£,2) that L € C(1,1), a 
contradiction. For some i, therefore, we must have 
L € C(i,2) - C(i,1) 
=) {NTIME(T, op,)| T, €8,} - U {NTIME(T, oP,)| T, € $,}- 
By Lemma 10, 


p, (L) € 9 {NTIME(T,)| T, € 85} - U {NTIME(T, )| T, € 8,3 
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for that same i. [J 


Remarks. (i) We do not know how to exhibit the particular language that 
must be in {NTIME(T,)| T, € 89} -U {NTIME(T, )| T, € 8,}- 

(ii) The same technique can be applied to DTIME, and it allows us 
to strengthen the results of diagonalization a bit. For example we can 


1/200 


use it to show DIIME(n”) g DTIME(n’ (1og n) )- (Take 


i/400 


P,; (n) = n(log n) for 0s i< 399.) 


Another key idea in Cook's proof and our extensions of it involves 
a universal IM simulator. So that we may speak with precision about 
universal simulation, let us now choose an appropriate program coding 
for TMs. With each ™ having at least two tapes and input alphabet 
{0,1}, we associate a distinct program code from f0,1}°; and we do this 
in agreement with the easily-satisfied conditions listed below. We use 
the notation ie for the set of program codes for k-tape TMs and Loic. 


for the set of all program codes. We denote by M, the TM with program 


code e. 


Condition 1. No program code is a prefix of another, and Ls ‘ is in 


DTIME(n) for each k. 


Condition 2. For each fixed k, there is a TM acceptor Up (a "universal 
simulator") with 
k 
L(Uy) = fex| e € Lic.’ ¥ € L(M,)}; 
: ‘ P k 
peer < c,* Time, (x) ifee€ He 
e 
where c, depends only on e. 


Condition 3. There is a recursive function oh i + i ei such that 
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£:L) oo, 4 Lee, for each k and such that Me(e) spends its first |e| steps 
putting e at its head on tape 2 (by writing backwards) and thereafter 
acts according to the transition rules of Mo: (This condition is a 


variant of the s)-theorem of recursive function theory [Rog 67].) 


Most common instruction-bv-instruction or Penton Serre codings of IM 
programs can be tailored to satisfy these conditions. An example of a 
satisfactory program coding is described in Appendix Il. 

We shall want to pad strings and use the simulator that we design 
in a recursive control structure. To this end we use Condition 3 to 
prove one more lemma, a version of the fixed point theorem (recursion 


theorem) of recursive function theory. - 


Lemma 12. For each k-tape TM acceptor M with L(M) c {0,1}", there is a 


k-tape TM acceptor Me with 
0 


LM ) = {x! e.x € LOM}, 
eo 0 


Ze (Time, (x) sc + Time, (e9x)) - 
e 
8) 


Proof. Let f£ be as in Condition 3. Take M, to be a k-tape T™ that 
1 


operates as follows, given x at its head on tape 1 and e at its head on 
tape 2: 

1. Convert e to ffe). 

2. Convert x to f(e)x, and erase everything else. 

3. Operate according to the transition rules of M on input f(e)x. 


Let &y = f(e,)- Then by definition M operates as follows on input x: 
0 
at the head on tape 2. 


1. Spend 'e,' steps putting e 


1 1 
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2. Convert ey to f(e,) = €: 

3. Convert x to eoX: 

4. Behave Like M on ox: 
Thus , 


x € Eo) @ @ox € L(M), 


Time, (x) sc + Time, (epx) » 
e 
0 


where c is the number of steps used in writing e,, converting e, to eo» 


1 1 


and writing eo in front of x. 0 


Theorem 13. If Ty is a running time, then 
NTIME(T,) - U {NTIME(T,)| there is some recursively bounded but strictly 


increasing function £:N 4 N for which 
T, (£(n#1)) € o(T, (£(n)))} 


contains a language over f0,1}.! 

Proof. Let Tt, be a running time, and let Up be the universal simulator 

of Condition 2 for k = 2. By Lenma 6, Lo (Uy) € NTIME(T,) - Let £:N49N 
2 


be any recursively bounded but strictly increasing function. We prove 


with T, (£(@+4)) € 


that L,, (U.) ¢ NTIME(T,) for any time bound T 
Ty, 0 1 1 


0(T,(£(n))). 


Suppose that U, accepts Ly (Up) within time Ty» where T, (£@41)) € 
2 


1 


o(T, (£(n))). By Lemma 4, there is an acceptor U for 


tthe operator gap theorem ([Con72], [Yng71]) shows that such re- 
sults are impossible without some "honesty" condition on Ty such as T, 


a running time. For example the operator gap theorem can be used to 
show that there are arbitrarily large, arbitrarily complex time bounds T 
for which NTIME(T(n)) equals NTIME(n-T(n+1)), even though T(n+1) is 
certainly a member of o(n*T(n+t1)). 
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LU) U L(g) = by, (Ug) U (Up) = LCUp) 


such that for every e € Le eee 


T,(lex|), if c,+Time, (x) < T,(|ex|)s 
Time,, (ex) < e 
cone in any event. 


Note that when T, (jex|) < Time, (x) <s T, (| ex|)/e,, the universal simula- 
e 


tor U will simulate the computation of M, on x faster than the computa- 
tion runs directly; i. e., there will be simulation time gain. This ex- 
treme efficiency will lead below to a contradiction of Lemma 9. 

Let L < {1}" be any recursive language over {1}. Because L is re- 
cursive, we can take a running time T so large that L € NTIME(T). Let M 
accept L within time T. Design a T acceptor M' that operates as 
follows: | 

1. Check that the input string is a member of Leet 10 and 

parse it into e € Le. xe€ {1}", and of. Condition 1 guaran- 
tees that this can be done in time that is linear in the length 
of the input string. 

2. Use a clock for the running time T to determine whether 

k 2 T(|x|). This requires at most k steps, so it can be done 
in linear time, too. 

3. If ke T({x|), then erase everything but x and compute on input 

x according to the transition rules of M. For x € L(M), since 
Time,, (x) < T(|x|) < k, this step can be performed in linear 
time, too. 


' 
4. If k< T(|x|), then pad the input string to ex0" for some non- 
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deterministically chosen k' > k, erase everything else, and 
compute on input exo” according to the transition rules of the 
universal simulator U. This step can be performed in linear 
time plus Time, (ex0™ ). 
To summarize the behavior of M' on exo 
k = T(|x|) = behave like M on x; 
k < T(|x|) = behave like U on x0 Foe sone kOe (thus simulating 
M, on x0k'y. 
To summarize the timing for exo € LUM), 
d_e 


; k! k! 
d, +|ex0 | + Time,, (ex0 ), if k< T(|x|) 


ex0"} , if ke T(|x]); 


Time, (ex0") < 


for some constant d) and every k' > k. 


Applying Lemma 8 to obtain a 2-tape TM that accepts L(M') with only 
linear time loss, and then applying the recursion theorem (Lemma 12) to 


this machine, we get a program code e, for a 2-tape TM that accepts 


0 
LM. ) = {x0"] e x0 € Lat')} c 10" 
& 0 


within time 


Time, (x0*) < d+ Time, , (e,x0") 


a) 


for some constant d,- 


* 
Claim 1. For each string x € {1} » the following holds for every k: 


x0 ELM )exeL. 
£9 


Proof. For each x we establish the claim by induction on k running down 
from k = T(|x|) to k = 0. 


k 2 T(|x|): 
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xo* € LM )ee xo" € L(M') 
&5 0 
(by choice of ey) 
exe€é LM =L 
(because by definition M' behaves like M in this 
case). 
. ' 
k< T(|x|): Assume xo* E LM, ) e x € L holds for every k' > k. Then 
6 
k k 
xO € L(M_ ) # e,x0 € L(M') 
ey 0 : 


(by choice of eo) 


, 
° e x0" € L(U) for some k' > k 


(because by definition M' behaves like U in this 


case) 
k' 
exd0 € LM, ) for some k' >k 
0 
Z 
(because ey € Loc.) 
exeEtL 


(by induction hypothesis). 0 


Claim 2. For each sufficiently long string x € L, the following holds 


for every n 2 | egx| : 


£(n)-| e,x| 
Time, (x0 )< d,-T, (f£(@a4)), 


“0 
where d., = dod, + d,- 
Proof. Let x € L be so long that 


eo ta T CEH) < T,(£(a)) 


for every n 2 | egx| - (This uses the "translational" hypothesis 


T, (£(@4H)) € o(T, (£(m)))-) We establish the claim for x by induction on 
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n running down from n so large that f(n) 2 | ep + T(|x|) ton = | ex| - 


f(n) = | epx| + T(|x|): 

£(n)-| egx| £(n) -| e,x| 

Time, (x0 < d,eTime,,, (e5x0 ) 
e 

0 


< dood, f(a) 


(because £(n)-| e,x| = T(|x|)) 


< dT, (£(n41)). 


| epx| <ns £(n) < | eox| + T(|x|): 


£(nt1)-| e,x| 
Assume Time, (x0 )< d,eT, (£(nt2))- Then 
e 


0 
£(n+1)-| e,x| 
c Tim (x0 ) <c_ ed,T, (£(n+2)) 
ey me eo 31 
< T,(£(+1)) 


(because n is so large). 


Therefore, 
f(n+1)-|e,x| 
Time, (e,x0 ds T, £@+1)). 
Therefore, 
£(n) -| e,x| £(n)-| e9x| 
Time, (x0 ds d,°Time,,, (e4x0 ) 
“o £(n+1) -| epx| 
< djed,+f(nt1) + d,+Time, (e 9x0 . ) 


(by padding out to length f(n+l) > f(n)) 
< ded, +f (n+l) + d,eT, (£(n41)) 


< d,eT, (£(nt1)) - Oo 


Claim 3. For each sufficiently long string x € L,: 


THe (x) < d,eT, (£(|e9%|+1))- 
0 


Proof. Ene We tag 9 te 


dale fay ai prabs y ok s la yrs frye gauss c 
eo Mee (x0 


(adds beab 2 
: €,(egx0 et a 8 hye wy FF 6 Sd ds : re? ~ 


ae ere eae Stet 


with M on short. ones. (those: mot xi 
‘This gives a TH that aceapts L = L0G 
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1, if n€ A; 
§(2n) = 
n, ifnéaA; 
n, if n € A; 
6(2n+1) = 
1, ifn¢ga. 


To see that NTIME(n7 +5 (n)) g NTIME(n”) just apply Theorem 13 with 


2n, if n € A; 
f(nt1) = 


2nt+1, if n ¢ A. 


In many applications it suffices to have Theorem 13 for the single 
function f(n) =n, especially if we are concerned only with nondecreas- 


ing time bounds. 


' Corollary 14. If Ty is a running time; then 
NTIME(T,) - U {NTIME(T, )| T, (ntl) € 0(7,(n))} 


contains a language over {0,1}. 


The informal diagram in Figure 1 illustrates how the proof of Theo- 
rem 13 uses padding to take advantage of deeply nested simulations by U 
to bring the time for an arbitrary computation down to the vicinity of 
Ty and Ty in the case f(n) =n. The direct computation on x, up around 
the level of T(|x|), is brought down to below T, in terms of the input 
TC|x|)_ 


length by padding x out to x0 By the hypothesized. nature of U, 


: f - 
1 If we un 


pad by a single 0, then the hypothesis. that T, @4) is small compared to 


simulating that computation brings its time down to below T 


T, (mn) keeps the computation still below T, in terms of the input length. 


T(|x|)-1 


A simulation by U of this computation on x0 brings its time down 


to below qT: Continuing to nest alternating unpaddings and simulations 


finally yields a computation on the original input string x down at the 
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Figure 1. + pad 


« unpad 


4 speed up by simulation 


(x,T(|x|)) 


ee ee ee ee ee ee 


number of steps 


*(x,T, (/x])), approx. 


. x0 x0" aa xor {lx} )-1 


xo! (| *|) 
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level of Ty and T,- 

The "translational" condition T, (oH) € o(T, (n)) is a severe one 
for a rapidly growing running time Ty: When T, (nt) is' worse than expo- 
nential in T,@), in fact, deterministic diagonalization within time 
bound Ty (Theorem 1) yields stronger results than dhentodcliary 14.. 
Because Corollary 14 applies for T, @H) € o(T, (n)) and Theorem 1 applies 
for log T, (n) 4 O(T, (a)), it is easy to see that Corollary 14 contributes 


new results precisely when log T, (n+) € o{T,(m)). 


27-4. 
Se aiend 
k 


To see the strength of Corollary 14, let log n= min{k| n < 
For constants c > 1, r 21 whose digits in radix notation can be generated 
rapidly, and in particular for rational c, r, note that n’, n® slog 'n, 
metlog” ay c", enelog” n, etc. are running times. Thus we conclude 
that 

NTIME(n*) g WrtMe(n™+10g* n) g NTIME(n™+(log” n)”) Gree, 

NTIME(c") S NTIME(c™s log” n) S NTIME(c"s (log” ny?) S eee. 
These results do not follow immediately from Cook's result (Theorem 3) 
or by diagonalization (Theorem 1). 

Corollary 14 obviously implies that 


2 2 
NTIME(2" ) g ntme(2""*1) .409* ny, 


92 gnt * 
NTIME(2 ) & NTIME (2 elog n). 


In fact we can strengthen these results to 


2 2 
NTIME(2" ) ¢ nrm™e(2 2) +», 
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on gut 
NTIME(2  ) S NTIME (2 ) 


by appeal to the following corollary. 


Corollary 15. Tf T, is a running time, then 
U {NTIME(T,)| T, (ntl) € 0(T,(n)), T,() € o(T, a))} ¢ HIME); 


and there is a language over {0,1} that. bears witness to this fact. 


Proof. Because T,(n) € o(T,(n)) implies 7, ((n+1) 42) € o(T, (nt2)), 
Corollary 14 gives a language Lc {0,1} in 
NTIME(T,(n+2)) - UJ {NTIME(T, (nt1))| T, (m+) € O(T,(n)), T,(m) € 0(T,(n))}- 
Applying Lemma 11 with | 

8, = {T,| T (41) € O(7,()), T (a) € (7, (@))}, 

8, = {1}, 

py @) =n +1, 

Po(n) =n +2, 
we conclude that either p,(L) or p,(L) is a member of 

NTIME(T,) - U {NTIME(T,)| T, (n+l) € 0(T,(n)), T,{m) € 0(T,(n))}. 


Containment holds by Lemma 7. (1 


Remarks. (i) Lemma 11 goes through equally well if we pad to the left 
rather than to the right. For this remark, then, we may assume that 
p,(L) = [0% 1x| x€L, |o"1x| = p, (|x| )} for i = 1, 2 above. 
For Up the universal simulator of Theorem 13, L = he, (n42) 
isfies the condition for choosing L in the proof of Corollary 15. One 


(Up) sat- 


might suppose therefore that L  % ) would be a witness language for 


T,( 
Corollary 15. If we slightly modify our program coding by concatenating 


a single 1 in front of each old program code and if we let Uy’ be the 
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naturally derived new universal simulator, then we do indeed get 


: = e = . | . 7 
hr cnt) Mo )=1 Tp (42) Mo? p, @) Similarly, if we further con 


catenate a 0 in front of each program code and let U5" be derived from 


t e " = 
Up by taking this into account, then we get be (ny Yo ) 


e = tt 
ol bn (n42) Uo? p,(L)-. Yet we can show only that either be cn) Yo ) 


t . ° 
or be (ati) Mo ) is a witness to Corollary 15. We leave it open whether 


there is necessarily a witness language of the form L (U,) and 
T, @) 0 


whether the particular choice of Uy affects whether L (Up) is such a 


T, (n) 
language. 
(ii) Corollary 15 contributes new results (over Theorem 1) precisely 


when log T, @+1) € O(T,(n)). 


It is interesting to note that the containments corresponding to 
the examples following Corollary 14 are not known to be proper for de- 
terministic time (DTIME). The fundamental reason is that Lemma 8 is not 
known for DTIME. The proof of Theorem 13 in the case of such an easy 
function f as f(n) =n does carry over in every other detail, however, 


to give Theorem 16. 


Theorem 16. Suppose that there is some fixed k such that for each de- 
terministic TM aeceptor M there is a deterministic k-tape TM acceptor M' 
and a constant c such that L(M') = L(M) and Time,,. (x) < ce £(Time, (x)). 
Then 

DIIME(T,) - \ {DTIME(T,)| f(T, (m+1)) € o(T,(n))} 4 6 


for every running time T,. 
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Remark. We do not require that M' be effectively constructable from M; 
if it were, then we could actually diagonalize to get 
DTIME(T,) - (J {DTIME(T,)| T,(n) € O(£(T, (n)))} # 6, 


a somewhat stronger result. 


Example. If we should discover even a nonconstructive proof that for 
each deterministic TM acceptor M there is a deterministic 5-tape TM ac- 
ceptor M' and a constant c such that L(M') = L(M) and 
Time,,, (x) < c* Time, (x), then we could conclude that 

DTIME(T,) - |) {DIIME(T,)| T,(n+1).€ o(T,(n))} 4 6 


for every running time T,- 


Padding strings over a one-letter alphabet by one character at a. 
time does not leave them decodable, so cannot hope. to use our method 
to get a result as strong as Corollary 14 for jeagusgeavoued a one-letter | 
alphabet. The final result of this chapter demonstrates that we Saal 
come very close, however. | 


Definition. The rounded inverse of a strictly increasing function 
Po-1) 


£:N +N is the function :N +N defined by 
FT] (n) = min{k| £(k) 2 nj. 
Examples. function rounded inverse 
n2 r2/21 
20 Flog, nl 
2 
2° * 
2 log n. 
—_—a 8 
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Theorem 17. If Ty is a running time and f is real-time countable,* then 


there is a language over {1} in 


r 


NTIME(T,) -U {NTIME(T, )| T,@ + £71 my) € o(T, (n))}. 


Proof. Let T, be a running time, and let f be real-time countable. To 
adapt the proof of Theorem 13, we must construct a witness Language as 
the T,-cutoff of some "universal simulator" having input alphabet {1}. 
We start with Up as in the earlier proof; i. e., Up is the universal 
simulator of Condition 2 for k = 2. 

Define an injection g:{0,1}" +N so that the binary representation 
of the integer g(x) is 1x; i. e., we concatenate a high-order digit 1 to 
x to get the binary representation of g(x). Define another function 
h:{0,1}" +N by the conditions 

n(xo) = btw) + eM ag), 

h(x1) = £(g(x1)) + g(x) - 1, 

h(QA) = £(1). 

Because g is an injection and f(n)+m-1 is strictly increasing, h(xl) = 
h(yl) only if x = y. pumas nt! 72! (ny is strictly increasing, h(x0) = 
h(y0) only if h(x) = h(y). Unless there are strings x, y with h(x0) = 
h(yl), therefore, h must be an injection. For such strings to exist, 


n 


the ranges of the strictly increasing functions see (n) and f(p)+n-1 


must intersect; but 


-1] 


(£(n)-1) + F (£(n)-1) = (£(@)-1) + (n-1) 


T4 strictly increasing function f{:N 4 N is real-time countable 
{Yam62] if some deterministic Turing machine generates the characteristic 
sequence of the range of f in real time (1. e., one character per step). 
(The characteristic sequence hag a 1 in position n if n is in the range 
of f and a 0 otherwise.) 
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A 


f(n) tn - 1 


A 


£(n) +n 


eq) + 7! ceQny, 


> 
so the ranges do not intersect and h is an injection. 


Because f is real-time countable, we can compute yo) from x or 


h(x) 


x from.1 within time proportional to h(x), within time 2eh(x) if we 


* 
wish. From Up we construct Uy! to operate as follows on input y € {1} : 
h(x) 


1. Find x with 1 = y if it exists. 


2. Compute on x according to the transition rules of Up: 


By Lemma 6, be, (Uy') € NTIME(T,). We prove that Ly 20 ') ¢ NTIME(T,) 


for any time bound T, with T 1° + re Veny) € o(T, oe 


1 


Suppose that U,' accepts L, (Uy') within time T,, where 
2 


1 
T, (n + Fel tnyy € o(T, (n)). By Lemma 4, there is an acceptor U' for 


Ly") U L(y!) = Ly Uy") U LEU") = LC") 


such that for every e € re ee 
es T(h(ex)), if 2eh(ex) + loa < T,(h(ex)); 
Time,,, (1 d< 


2eh(ex) + i aikae i in any event. 


* 
Finally, construct U to operate as follows on input x € {0,1} : 
h(x) 


P&) 


1. Reigate 1 
2. Compute on according to the transition rules of U'. 
Then 

L(u) = {x} P& ¢ 1} 


fx] 1° € 1¢u5")} 


L(U,) 5 
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2 
and, for every e € Lo .e? 


Time, (ex) < 2+h(ex) + Time,,, (1°¢€*) ) 


2eh(ex) + T, (h(ex)), if 2eh(ex) + c° Time, (x) 
e 
s 
< T, (h(ex)) ; 
4eh(ex) + “nS in any event. 
* 
For any recursive L c {1} , we can use U just as in the proof of 


* 
Theorem 13 to get a 2-tape TM acceptor M. for LeQ , with 


0 
k 
d.e O |, if k T > 
Time, (x0%) << 1 |egx0 | tal) 
M djefe xo 4 4 time (ex0**), if k < T(\x|) 
£0 1°! &o* 1° 7mey XQ ? ; = 


for some sufficiently large constant qd) and some appropriate time bound 


T. 


Claim. For each sufficiently long string x € L, the following holds for 


every k: 
Time, (x0*) < dyoT, (a(egx0™)), 
e 
0 
where d, = 4d,- 


Proof. Let x € L be so long that 
(2 + a a + TeT nyy < T,(n) 
for every n 2 h(epx). We establish the claim for x by induction on k 
running down from k 2 T(|x|) to k = 0. 
k = T(|x|): 
cae a (x0*) < d,+| e,x0"| 


0 


k+1 
< dy+T,(h(e,x0")). 


k < T(|x|): 
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Assume Time, (xo +1) sd 9°T, (h(e,x0*)). Then 


£0 
2eh(e x08ty + ¢ “Time, (xo*t1, 
0 & 
e 
0 
k+l) c, Se 9*T, ale, x0***)) 


) +e, edyoT, (h(ey xoett 


0 
(2 +c, dy)oT, (h(e, xoktl 4 Te ance XO" 
£ 


< 2eh(e,x0 


k+1 +1 


) + let ance x0" 


2+h(e,x0 »)) 


+1 


A 


))) 
+1, 


A 


T)(h(egx0""#)) 


(because x is so long). 


Therefore, 


k+l 


Time,,(e x0?) < 2+h(e,x0t) + T, (h(epx0*4)) 


< 37, (h(epx0*4)), 


Therefore, 

k. k+l 
sia (x0) < d,+| 5x0 
0 


k+1 
| + d, ¢ Time, (e,x0 


k+1 k+1 


< dy+|egx0°™ | + 34,-T, (h(egx0™”)) 


< d,-T, (n(e,x0y). 
If H is a nondecreasing recursive function so large that 
* 
h(y) s H(|y|) for all y € {0,1} , then the claim gives the following for 
every sufficiently long x € L: 


Time, (x) < d,*T, (h(e,x0)) 
e 
0 


dy*T, (h(epx) + eM nce) 
< T, (h(epx)) 
s >>) T5(n") 


n'<i(|eo| +x) 
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< Zz T,(n'). 
n'<H(2e| x| ) 


It follows by Lemmas 4, 5 that L € NTIME( 3% T,(@")). Since L is an 
n'sH(2n) 


arbitrary recursive language over {1}, this contradicts Lemma 9. ™ 
2 
Example. Taking f(n) = 2? » we get a language over {1} in 
ee aed 
n 
22 


* 
NTIME(2"*log. n) - NTIME(2"). 
We close with a list of open questions. 


1. For Ty a running time, is the condition Ty ¢ o(T,) enough in general 
for separation between NTIME(T,), NTIME(T.) or between DTIME(T,), 


DTIME(T,)? 


2. Is there an actual difference between the separation results that 
hold for NTIME and those that hold for DTIME? 


DTIME(n7) g DIIME(n’+1og log n)? 


on gat * 
NTIME(2 ) g NTIME(2 /log n)? 


Is there a language over a one-letter alphabet in 


gntl on 
NTIME(2 ) - NTIME(2” )? 


3. What is the relationship between NTIME and DTIME? 
NTIME(T) = DTIME(T)? 


4. That a language L is not a member of NTIME(T, ) means only that every 
acceptor M for L has Time,, (x) > T, (|) for strings x € L of infi- 


nitely many lengths. Stronger senses of lower bounds, requiring 
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that Time, (x) > T, (|x|) for strings x € L of all but finitely many 
lengths or for all but finitely many strings x € L have been studied 
extensively. (See [Blm67], [Lyn72], [GB74], for example.) It is 
known, for example, that there is a language L that requires oll 
many steps deterministically on almost every string x € L but that 
can be accepted deterministically within time (2+¢)™ for any ¢ > 0. 
Our methods do not give such results for nondeterministic acceptance 
time complexity, so we leave it open whether there is a language L € . 
NTIME((2+¢)") that requires, even on nondeterministic machines, 2|*l 


steps on inputs x € L of all but finitely many lengths or on ali but 


finitely many x € L. 


A purely technical question arising from Theorem 13 is whether we 
can allow f to range over all one-one functions rather than just 
strictly increasing, recursively bounded ones. A plausible proof 
strategy is to design M' in the proof of Theorem 13 so that, in the 
case k < T(|x|), it pads or unpads ex0* to ex0" for some nondeter- 
ministically chosen k' # k. Under this strategy, however, Claim 1 


seems to elude proof. 


What is the relationship between deterministic time complexity and 


number of worktapes? 


What is the relationship between time complexity and worktape alpha- 


bet size? (Cf., Chapter Three.) 


Is there any language in NTIME(T,) that requires more time than the 


language L,. (Uy) in the proof of Theorem 13? 
2 


Al 


9. In the conclusion of Lemma 11, can we exhibit a single language that 
must definitely belong to - {NTIME(T,)| Ty € $5} -\ {NTIME(T, | 


Ty € 81}? (Cf., Remark (i) following Corollary 15.) 
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CHAPTER THREE 


SPACE SEPARATION THEOREMS FOR 


OFF-LINE TURING MACHINES 


1. Basic definitions 


To study Turing machine storage space complexity, we adopt a Turing 
machine model that has a read-only input tape and a single read-write 
worktape. The input string is received between the special endmarkers 
¢, $ on the input cand and is read by a single read-only input head 
which is allowed to move freely between the endmarkers. The worktape is 
infinite to the right only. For technical reasons, we allow any fixed 
finite number of freely moving, but initially lLeft-adjusted, read-write 
heads on the worktape. The worktape heads can detect both each other and 
_the left end of the worktape, and they are never required to write con- 
flicting symbols on a single tape square in the same step or to shift 
left past the left end of the worktape. We refer to such an automaton 
as an off-line TM. An off-line TM with m > 2 symbols in its worktape 
alphabet (counting the blank symbol, which may be used without restric- 
tion even in overwrite instructions) and £ 2 1 worktape heads is called 
-an (m,£)-machine or just an m-machine. The deterministic restrictions 
of these automata are called deterministic off-line TMs and deterministic 
(m,£)-machines, respectively. 

An off-line ITM can act as an acceptor by halting in some specified 


accepting state and with a blank worktape at the end of some computations. 


Definition. Let M be any off-line IM acceptor. M accepts the string x 
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if there is some accepting computation by M on input x. M accepts the 
language L(M) = {x| M accepts string x}.? For x € L(M), Space, (x) is 
the minimum number of distinct worktape squares visited by the worktape 
heads of M in an accepting computation by M on x; for x ¢ L(M), 
Space, (x) =o. For S:N +N, define 

Lg(M) = {x| Space,(x) < S(|x|)}, 

NSPACE(S,m,£) = {L| L.= L(M) = Lo) for some (m,£)-machine M}, 

NSPACE(S,m) =() [NSPACE(S,m,2)| £ = 1}, 

NSPACE(S) =|) {[NSPACE(S,m,f#)| m2 2, £2 1}, 

DSPACE(S,m,#) = {L] L = LM) = Lo@M) for some deterministic (m, t)- 

machine M}, 

DSPACE(S,m) =|} {DSPACE(S,m,£)| £2 1}, 

DSPACE(S) = {DSPACE(S,m,2)| mz 2, £2 1}. 
We call Ls@) the S-cutoff of M, and we say M accepts within space S if 
LW) = L,(™). If NSPACE(S) contains languages which are not regular, 
then S is a space bound. Every subscripted or primed S mentioned below 


is assumed to be a space bound. 
Proposition 1. No space bound § satisfies S(n) € o(log log .n). 
Proof. See [HU69a]. 


It is well known that the NSPACE(S) and DSPACE(S) complexity classes 
are generally insensitive to machine medel design variations. The 
NSPACE(S,m,%) and DSPACE(S,m,£) complexity classes, on the other hand, 
are sensitive to machine model design; but the differences are usually 

acceptance is to be distinguished from "recognition." If the off- 


line TM M can accept either Lc YH or Y - L (within space S), depending 
on accepting state designation, then M recognizes L (within space S). 
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minor. Following are comments on the effects of some common design 
variations. 

1. Suppose that we redefine our (m,f)-machine model so that its 
worktape heads cannot detect each other. If the resulting complexity 
classes are NSPACE'(S,m,£), DSPACE'(S,m,£), then we have 

NSPACE'(S,m,£) = NSPACE(S,m,£), 

DSPACE'(S,m,£) = DSPACE(S,m,£). 

To. see that detectability is no real advantage, it suffices to observe 
that detection can be simulated by the redesigned model.- The trick is 
to make a temporary change under each worktape head in-turn, letting 
each head discover which other heads’ temporary changes take place on 
the square it scans. 

2. Suppose we redesign our (m,f£)-machine model so that it cannot 
detect the left end of its worktape but instead halts without accepting 
if it shifts past that end. If the resulting cmeupiextey classes are 
NSPACE' (S,m,£), DSPACE'(S,m,#), then we have. 

NSPACE'(S,m,£) C NSPACE(S,m,£) C NSPACE! (S,m, £41) , 

DSPACE'(S,m,£) Cc DSPACE(S,m,£) C DSPACE'(S,m, +1). 

Our model simulates the redesigned one plasty by halting when it detects 
that the transition rules would lead to a shift off the end of the work- 
tape. The redesigned model simulates ours by permanently stationing an 
extra worktape head at the leftmost worktape square. Detection of that 
square can then be effected by the trick of comment 1 above. 

3. Suppose we redesign our (m,£)-machine model so that its work- 


tape is infinite in both directions. If the resulting complexity classes 
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are NSPACE'(S,m,£), DSPACE'(S,m,£), then we have 

NSPACE'(S,m,£) C NSPACE(S,m,£+1) C NSPACE'’(S,m, £+2) , 

DSPACE'(S,m,%) c DSPACE(S,m,£+1) c DSPACE'(S,m, £+2). 

To simulate the redesigned model, our model must be able to provide new 
worktape squares for shifts past the left end of the worktape. It suf- 
fices to shift all the work to the right (making temporary use of the 
worktape head that needs the new tape square), and this is made possible 
by using an extra worktape head to mark the rightmost worktape square 
that has been visited. (Nothing to the right of this head need be 
shifted because it is all blank: anyway.) The redesigned model simulates 
ours by permanently stationing an extra worktape head at the initial 
worktape square and treating that square as the left end of the worktape. 

In the nondeterministic case we actually have 

NSPACE'(S,m,£) C NSPACE(S,m, £) 
because our model can nondeterministically guess where to start its 
simulation so that no shift past the left end of its own worktape is 
called for. 

4. Suppose that we redefine acceptance by our (m,¢)-machine model 
so that a blank tape is not necessary. If the resulting complexity 
classes are NSPACE'(S,m,4£), DSPACE'(S,m,#), then we have 

NSPACE'(S,m,#) C NSPACE(S,m,f+1) c NSPACE'(S,m,£+2), 

DSPACE' (S,m, 1») Cc DSPACE(S,m,$+1) c DSPACE'(S,m, +2). 

Our model simulates the redesigned one simply by erasing its worktape 
when the transition rules call for acceptance. This is made possible by 


using an extra worktape head to mark the rightmost worktape square that 
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has been visited. (Nothing to the right of this: head need:-be erased be- 
cause. it is all blank anyway.) The redesigned model simulates ours by 
checking whether its worktape is blank before entering the accepting 
state. This ia made pessible by. again using: an extra worktape head to. 
mark the rightmost warktape square that haa been visited. 

In the nondeterministic. case we actually have 

NSPACE' (S ,m, 6)’ C NOPACE(S ,m,£) 
because: our model cam nondeterminietically guese: where to: start erasing: 
in preparation for acceptance: 

5: Suppose we: redastem our (m,()-mechine model! so: that it has k. — 
worktapes. If the nesulting: complextty classes: (pbvained by counting 
the. tatal number of visited: worktape: squares, the total alphabet size, 
and the total number of worktape: heads) ane: NSPACE(S,m,,£):,, DSPACE'(S,m,£) , 

_then we: have 

NSPACE‘ (S,m,£): < NSPACE(S ,m,.#+k) C NOPACE' (Sim, £tk):, 

DSPACE! (S:,m,.6)-C DSPACE(S,m,; fet):  DBBAGE! (Sm, sts)’. 

Our model simulates the redesigned. one by storing the concatenation of 
the visited: pertions: of. the: k tapes om ibs: one: tape. The: k extra heads 
hy> ewe 2h, are: used: to: delimit: these k: spgments.. New worktape: squares: 

are provided: where. needed by: shifting: work right,. much as: in comment 3. 


above. 
os Foe. f 
Be a i Me 


The simulation of our model by the redesigned ane is trivial. 
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6. Suppose that we redefine our (m,£)-machine model so that the 
blank symbol is reserved for worktape squares that have not yet been 
visited. If the resulting complexity classes (obtained by counting only 
nonblank worktape symbols now) are NSPACE'(S,m,#£), DSPACE'(S,m,£), then 
we have ji 

NSPACE'(S,m,£) © NSPACE(S,m,£+1) Cc NSPACE'(S,m+1,£+1), 

DSPACE' (S,m,£) C DSPACE(S,m,£+1) Cc DSPACE'(S,mt+tl1,£+1). 

Our model simulates the redesigned one by using its blank symbol for one 
of the ordinary symbols of the new model. An extra worktape head is 

‘used to mark the rightmost worktape square that has been visited, beyond 
which the blank represents the true blank symbol of the simulated machine. 
The redesigned model simulates ours by using an extra unrestricted sym- 
bol along with its restricted blank symbol to represent the unrestricted 
blank of our model. 

The relations among design decisions revealed by considerations 
such as those above provide a convenient way of converting the results 
of this chapter to good results for any of the redesigned machine models. 
Slightly better results often are obtained by converting the original 
proofs, however, making better use of nondeterminism (cf., comments 3, 4 


above) or of worktape heads not yet fully utilized, for example. 
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2. Basic containment. relations 


In this section we present all the known containment relations 
among the complexity classes defined in Section 1. The trivial iaiatiene: 
are that no language is lost from a complexity class by allowing nonde- 
terminism, additional space, additional worktape symbols, or additional 
worktape heads. 

Only slightly Less trivial is the use of the finite state control 


to save space. 


Proposition 2. If S,(n)-S, (a) € O(1), then 
NSPACE(S, ,m,£) C NSPACE(S, »m, £) ’ 


DSPACE(S, sm, 8) C DSPACE(S, 2m, £)- 


It follows, for example, that the complexity class psPace(n!/? 2,1) is 
not affected by how we round the square root. For convenience, therefore, 
we allow such an imprecise specification of a space bound when the pre- 
cise specification is not relevant. 

The basic relationship that DSPACE (S.) Cc DSPACE(S, ) whenever 
S, € o(s,) appears in [SHL65]. It allows us to speak of DSPACE(log n) 
without specifying the base of the logarithm, for example. Our next 


proposition generalizes the relationship. 


Proposition 3. If S(n) < §*S'(n) for some fixed rational number 
6 < log. m', then 
NSPACE(S ,m,£} C NSPACE(S' ,m' ,f#), 


DSPACE(S,m,£) C DSPACE(S',m',£). 


Proof sketch. Say § = i/j for positive integers i, j. As - < nti, we 
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can encode the contents of i m-symbol-resolution worktape squares in j 


m'-symbol-resolution worktape squares. 


Example. For k a positive integer, 


NSPACE(keS,m) = NSPACE(S,m*). 


Additional worktape heads often can satisfy an apparent need for 
additional worktape symbols. Our technical reason for allowing several 
worktape heads is that additional worktape heads amount to much less 
additional space than additional symbols do. Proposition 3 establishes 
the close relationship between worktape symbols and a linear multiple of 
worktape space, and our next two propositions establish the close rela- 


tionship between worktape heads and the logarithm of worktape space. 


Proposition 4. For every ¢ > 0, 
NSPACE(S, m, £+k) C NSPACE(S + (k+ite)+log S, m, £), 


DSPACE(S, m, £+k) C DSPACE(S + (ktl+te)+log S, m, 2). 


Proof sketch. Let M be an (m,f+k)-machine that accepts within space 
S(n). We wish to design an (m,£)-machine M' that simulates M within 
space S(n) + (kt1+e) «log | S(n). 
The first g-1 heads of M can be simulated by the first {-1 heads of 

M'. The position of each of the other k+l heads of M can be stored by 
M' as the m-ary representation of that eeivions If these k+l strings 
are properly delimited, the last head of M' can carry them around and 
access them to simulate all of the last k+l heads of M. Since only fi- 
nitely many (k+2) delimiting marks are required, a single extra bit in- 


serted every j symbols of the list can be used in conjunction with fi- 
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nite-state memory to locate the marks. Each of these bits is set to l 
if and only if at least one of the k+2 delimiting marks should be 1lo- 
cated on one of the next j worktape squares. Since j and k are fixed, 
the precise locations of the marks relative to the bits that are set to 
1 can be maintained by finite-state memory. The list itself accounts 
for an extra space requirement of (k+1)-log. S(n), and the additional 
requirement for delimiters can be kept to an arbitrarily small fraction 
of that by choosing j large enough. 


Clearly, M' is deterministic if Mis. ™ 


Proposition 5. 
NSPACE(S + kelog S, m, £) C NSPACE(S, m, £+k+3), 


DSPACE(S + kelog S, m, £) C DSPACE(S, m, £+k+3). 


Proof sketch. Let M be an (m,£)-machine that accepts within space 
S(n) + kelog, S(n). We wish to design an (m,£tk+3)-machine M' that 
simulates M within space S(n). 

If S happens to be easy to compute, then MI can start by stationing 
head A at worktape square S(n) and head B at worktape square S(n) - 
log, S(n). 


S(n) 
ee eee 


eat 
log, S(n) 


head B head A 
The worktape of M is conceptually parsed into an initial segment of 
length S(n) - log. S(n) and k+l "pages," each of length log. S(n). The 


initial segment will always reside in the first S(n) - log. S(n) work- 
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tape squares of M'. One page at a time can reside in the worktape 
squares of M' delimited by heads B and A. Each page not residing there 
can be stored as a worktape head position, the page being the m-ary 
representation of the position. 

In its simulation, M' tries to use £ of its worktape heads to behave 
like M'. -A record of the current location of each page (resident or 
stored as some head position) and the page currently scanned by each 
head of M is maintained in the finite-state control of M'. When the 
heads of M scan different pages or move from page to page, "paging" is 
required. None of the g simulating heads is moved from its proper loca- 
tion, but the one free head is used (with some help from head B) to 
store away the page that is currently resident. The required page is 
then loaded (again with help from head B), leaving the head that stored 
it free. 

The simulation for arbitrary S differs in that heads A and B are 
restationed during the simulation according to how much space M has 
actually used. When M has used s' worktape squares, with 

(s-1) + kelog (s-1) <s' ss t+ kelog | S, 
head A will be at position s and head B will be at position s - log, s. 
Restationing is required only when some simulating head is coincident 
with head A (and scanning the final page), so a second head is tempo- 
rarily free to help the usual free head to determine whether head B must 
be restationed. (Head A is restationed every time s changes to s+l, but 
head B is restationed only when Llog | s| = Llog. (stl) |.) Adjusting the 


pages on restationing is easily managed with some help from the finite- 
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state control. 
Clearly, M' is deterministic if Mis. M1 


Our final basic containment relationship is the well known result 
of [Sav/0]. 
Proposition 5. If log n = O(S(n)), then 


2 
NSPACE(S) C NSPACE(S’). 
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3. Notions of honesty 


Qualitatively, a function is "honest" with respect to space if it 
can be computed without using space that is too much greater than both 
its argument and its value. It is easy to check that functions of prac- 
tical interest are extremely honest. In fact, all of the common func- 


tions are of the following type. (See [Rit63].) 


Definition. A function f:N 4» N is linear space honest if 
{bin(k)#bin(f(k))| k € N} € DSPACE(n), 

where we use the notation bin(k) for the binary representation of k 

(high-order bit first, say). Equivalently, f is linear space honest if 


c1*of ©) & € NI} € DSPACE(1og n). 


Our main goal in this chapter is to discover weak separation condi- 
tions for the complexity classes defined in Section 1; e. g., we seek a 
generally sufficient condition on Sy: S5 for the nonemptiness of 
NSPACE(S.) - NSPACE(S,)- Well known "gap" theorems, however, show that 
any reasonable separation condition must include some sort of honesty 
requirement on at least one of the space bounds involved. (See [Bor/72], 
[Con72], [Con73], [Yng71].) The most commonly used ([1Ib72], [Savw/0], 


{BGIW70], [Bk72]) notion of an honest space bound is the one we adopt. 


Definition. If f:N +N does not belong to O(1) and M is a deterministic 
* 
off-line TM acceptor with L(M) = 1 and Space,(x) = f(|x|), then f is 


fully constructable and M fully constructs f. 


Proposition 7. 


(i) Every fully constructable function is a space bound. 
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(ii) Let f be linear space honest. If log n € o(f(n)), then f is 
fully constructable by a (2,1)-machine. If log n € O(f(n)), then f is 
still fully constructable. 

(iii) Let S be fully constructable by an (m,£)-machine, and let M 
be an (m,f£)-machine. Then L™) € NSPACE(S,m, £+1); and if M is determi- 
nistic, then L, (M) € DSPACE(S,m, g+1). 

(iv) There are fully constructable space bounds in O(log log n). 
(Cf., Proposition 1.) 

(v) If S is fully constructable by an. (m,g)-machine and 1 € o(S(n)), 
then S satisfies 

Tog, n- Lolog, log, n - S(n) € 0(1), 
from which it follows that 

log, n - S(n) € O(log Iog nj}, 

log n € 0(S(n)}. 

Proof. (i) Let f be fully constructable. Since f(n) ¢ 0(1), the lan- 
guage 

coXijo* j21, k < £(j+2k)} € DSPACE(f) 
is not regular. 

(ii) Assume f is linear space honest and log n € o(f(n)). Every 
language accepted deterministically within space n can actually be 
recognized (cf£., footnote on page 43) within space n [HU69a], so let the 
(2,1)-machine M deterministically recognize {bin(k) #bin(£(k))| k € N} 
within space O(n). To fully construct f(n), compute according to the 
transition rules of M successively on 


bin(n)#bin(0), bin(n)#bin(1), bin(n)#bin(2),... 
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until bin(f(n)) is discovered, and then convert bin(f(n)) to unary. As 
both log n and log f(n) belong to o(f(n)), this does fully construct 
f(n) for all sufficiently large n; the differences can be handled by the 
finite-state control. With care, the entire program can be carried out 
by a (2,1)-machine. 

If. only log n € O(f(n)),. then using a Large enough worktape alphabet 
keeps the search for bin(f(n)) smaller than f(n) itself. 

(iii) An acceptor for L, (Mf) fully constructs space S and then com- 
putes according to the transition rules of M within that space. The ex- 
tra head is left by the first phase to delimit the space used. 

(iv) Define f£(n) = minfk| n is not divisible by k}, S(m) = log f(n). 
Obviously S is fully constructable. Let x(k) be the number of primes 
smaller than k. The least nu with f(n)} & k is the least common multiple 
of {k'| k' < k}, which certainly exceeds gm(k) | Hence, — 
n(f£(n)) < log, n. According to the prime number theorem [NZ60], 
k/log k € O(x(k)); so 

e(n)!/? € o(e(n)/1og £(n)) 

C O(xn(£(n))) 
Cc O(log n). 
Therefore, 

S(n) = log f(n) € O(log log n). 

(v) Suppose the d-state (m,g)-machine M fully constructs S. We 
show below that S(n) = S(n + kn!) for every positive integer k whenever 
log n - helog log n - S(n) > log d. It follows that 


log. n- £-log log. n - S(n) € O(1) = 1 €@ o(S(n)). 
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Let S(i,n) be the number of distinct worktape squares visited 


L time that M scans an input endmarker on either end of 


through the if 
the input while computing on input 17, and let — 

Q(i,n) € {¢,$} x {1,..-,d} x com x {1,...,S(n)}4 
describe the total state of M at the end of that time. (If there is no 
ry endmarked total state, then Q(i,n) = undefined.) 

For log. - Lelog. log. n - S(n) > log. d, we show by induction on i 
that S(i,n) = S(i, n + kn!) and Q(i,n) = Q(i, n + kn!). That 
S(i,n) = S(i, n + kn!) for all i implies S(n) = S(@m + Im‘). 

Since M has a fixed initial state, Q(1,n) = Q(1, n + kn!) and 
S(1,n) = S(1, n + kn!) = 1. 

Suppose Q(i,n) = Q(i, n + km!) and S(i,n) = S(i, n + kn!). To 
prove Q(itl,n) = Q(i+l, n + kn!) and S(iti,n) = S(itl, n + kn!), we 


consider four cases: 


Case 1: Q(i,n) = undefined. Obviously, 


Q(itl,n) = Q(i+l, n + kn!) = undefined, 

S(itl,n) = S(i,n) = S(i, n + kn!) = S(it+l, n + kn!). 

Case 2: Q(i,n) is defined, but Q(itl,n) = umdefined. Since n + kn! 2 n, 
the computation continuations are identical. 

Case 3: Q(i+tl,n) is defined and involves the same endmarker as Q(i,n). 
Since n + kn! 2 n, the computations are identical from the ire 
endmarked total state up to the (i41) 8* endmarked total state. 

Case 4: Q(itl,n) is defined and involves the other endmarker. In going 


from Q(i,n) to Q(itl,n), M first reaches each input square 


j € {1,...,n} in some memory state f(j). Because 
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dom ™ snp <n 
is implied by 

log, n - Lelog log. n - S(n) > log. d, 
however, £(j,) = £(j,) for some i, < jn € {1,---,n}. Clearly, 
therefore, increasing the input length by any multiple of jo-d, 
results in the same next endmarked total state and no new memory 


states. Certainly kn! is a multiple of Jo-4,- 0 


Criteria slightly different from ours for "acceptance within space 
S" have been proposed. Book [Bk72] requires that every accepting compu- 
tation on input x involve no more than S(|x|) worktape squares, and 
Ibarra [Ib72] requires that every computation on input x involve no more 
than S(| x] ) worktape squares. The significance of the proof of part 
(iii) of Proposition 7 is that the complexity classes determined by 
fully constructable space bounds are hardly affected by these differences. 

While part (iv) is surprising, part (v) of Proposition 7 redeems 
our intuition that a radix count of the input length fully constructs 
nearly the smallest possible fully constructable space bound. The 
result implies that one may substitute the innocuous hypothesis 
1 € o(S(n)) whenever the apparently more arbitrary condition 
log n € O(S(n)) arises for a fully constructable space bound S. 

Hopcroft and Ullman [HU69a] work with space bounds that are merely 


"constructable." 


Definition. If M is a deterministic off-line TM acceptor with 


S(n) = max{ Space, (x)| x € LM), |x| =n}, 


then S is constructable and M constructs S. 
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An interesting corollary of Proposition 7(v) and the existence of con- 

structable space bounds S(n) € o(log n) with 1 € o(S(n)) [SHL65] is that 
not every constructable space bound is fully constructable. Because we 
cannot prove Proposition 7(iii) for constructable space bounds, however, 


we choose not to use the concept. 
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4. Conventional separation results 

Counting and diagonalization arguments ([HU69a] and [SHL65], re- 
spectively) have been used to prove separation results among the 
NSPACE(S) and DSPACE(S) complexity classes. (See Corollaries 9, 11 be- 
low.) In this section we sketch more careful versions of these arguments 
to show what conditions they yield for separation among the more refined 
classes NSPACE(S,m,£) and DSPACE(S,m,£). For details, the reader is 


referred to [HU69a], [SHL65], [HU69b]. 


Theorem 8. If S, is fully constructable by an (m,%)-machine, then there 
is a language over {0,1} in 
DSPACE(S,, »m, £+1) 
- CU {NSPACE(S, .m,£)| S,'(n)-2+8,(n) € 0(1)} U 
) {DSPACE(S, »m,4-1)| S5'(n)-S,(n) € 0(1)}), 


where S,'(n) = min{S,(n), log | n- Lelog log | n}. 


Proof sketch. Define 


* 
L = {x| x = uyu® € {0,1} for some u with 


S5(|x|) t 
[ul = minf{ | |x| /2), m *S, (|x|) its 
where u® is the reverse of string u. (Note here that 
$5‘ (|x| 


) 
“s,'(|x|)*.) 


We first show that L € DSPACE(S, »m,£+1) . An acceptor for L can 


[ul <m 


first lay out space S,(]x|), using the extra head to delimit that space. 
The delimited space can be used as a counter to compare successive char- 


acters from the two ends of the input string. Because 2 extra heads are 


S (|x|) 


available, the counter is large enough to count up to m ‘ “S,([x|)?. 
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Next, we show that L ¢ NSPACE(S, .m, £) unless S,'(n)-2+S, (a) € 0(1). 
By the reasoning of [HU69a], for a d-state (m,f)-machine to accept L 


within space S,, we must have 


1 


S,'(n) S,(n) 
m 2 “S,'(a)# (dem 1 +8, (n)*y? 
2 <4 7 
Taking logarithms twice gives 


S,'(n) + fe log S,'(n) + cnstnt 


1* 2-(S,(n) + Le log 8, (n)) + cnstnt,, 


so that S$," (n)-268, (n) € O(1). 

Finally, we use similar reasoning to show that L ¢ DSPACE(S, sm, £-1) 
unless S,'(2)-S, (n) € 0(1). The behavior of a deterministic off-line ™ 
at an input boundary can be described as a function from the storage 
states into the storage states plus the “accept" and "nonaccepting no- 
return" outcomes. For a deterministic d-state (m,f-1)-machine to accept 
L within space S 

$5" (n) 


L 
m eS ‘(n) i) (n) 
2 & < (2 +dem | 


1’ therefore, we must have 


Taking logarithms twice gives 


S,'(n) + £elog S,' (a) + cnstnt, < S, (n) + £-log S, (2) + cnstnt 


1 2? 


so that S,'(n)-S, () € ocl). O 
Corollary 9 [HU69a]. If S, is fully constructable, then 
DSPACE(S,) - U {NSPACE(S,)| min{S,(n), log n} ¢ 0(S,(a))} 
contains a language over {0,1}. 
Proof. Take m so large that Sy is fully constructable by an (m,1)- 
machine. For S,'(n) = min{S,(n) , log. n- log. log, n}, Theorem 8 gives 


a language over {0,1} that bears witness to the noncontainment in 
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U {NSPACE(S, )| min{S,(n), log n} € 0(S, (n))} 
=U {NSPACE(S,)| S,' € 0(8,)} 


ety {NSPACE(k+S, ,m,1)| keEN, S,' € o(s,)} 


=U [NSPACE(S, »m,1)| S,' € 0(S,)} 


c\J {NSPACE(S, ,m,1)| $)'(n)-2+S, (mn) € 0(1)} 


2) DSPACE(S,, om,2) 


Cc DSPACE(S,) - O 


Theorem 10. if Sy is fully constructable by an (m,{+2)-machine, then 


there is a language over {0,1} in 


DSPACE(S, ,m, £+3) 


-U {DSPACE(S, .m, £)| S,(n) - 26S, (n) - f+log. S,(@) ~ log 2 
€ 0(1)}. 


Proof sketch. Design a deterministic (m,#+3)-machine M to operate as 


follows on input ex, where eis the description of a deterministic 


(m,#)-machine M_: 


1. 


2. 


Lay out space S,({ex|), using head A to bound it. 
Use £ worktape heads to carry out a simulation of M, on input 
ex, using head B to bound the simulation. (The simulation re- 


quires no more space than'c, + Su (ex), where c. depends only 
e 


one; and it requires no additional worktape heads to read the 
description of M, because that description can be carried around 
and read by one of the £ heads already being used.) Meanwhile, 
use head A to keep m-ary count of the simulated steps, and use 


head C to mark the high-order end of the counter. 


S,(| ex|) 
simulation (£ pe): asec 2 x 1 blanks-«- 
tt B eeu €. . . shead A. 


3. -If the simulation is completed peters: ‘the simulation and the 
count run out of free space, then complepent ¢ the. eugcome of the 
simulation; otherwise, just accept.~ 

Now peepose M, is a deterministic d-state ooo that perepes _ 


within space S,, where Ata) ¢€ 0(1) for 


1’ . - 
A(m) = S,(m) - 268 1 - solos, s, (a) - tom, co 


Take x so that au >, +d. If ex € LM, de then it must be peers 


ex| ) 
within isjadica? °S dexl)* steps g by M..  Othervise, a total 


state would Fepeat, and M, would loop corer: on ex. a Since 


cot s,¢ ex|) + log, a ex| at if a1 ae A 


=e, + log. d + S, (| ex|) - ACjex|) 
= S)(jex|) - G(fex|) - (c, + 4)) 
< S,(lex|), 
M does discover that ex € L(M,) and arrange .ex ¢.1(M).. On the other 
hand, if ex ¢ L(M,), then M will certainly accept ex. Therefore, 
LM.) # LM). O 


Corollary ll {SHE65]. If S, is fully constructable, then 
DSPACE(S,) - U {DSPACE(S,)| 8,(n} ¢ 0(S/{n) + Tog n)} 


contains a language over {0,1}. 


Proof. Take m so large that S, is fully constructable by an (m,1)- 
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machine. Theorem 10 gives a language over {0,1} that bears witness to 
the noncontainment in 
U { DSPACE(S, )| S,(n) €¢ 0(S,(n) + log n)} 
=U {DSPACE(keS, »m,1)| k €N, So(n) ¢ 0(S,(n) + log n)} 
=U {DSPACE (S, »m,1)| S,(n) ¢ 0(S,(n) + log n)} 
(oa 8 {DSPACE(S, ,m,1)| S,(n) - 268, (n) - log. 8, (n) - log. n ¢ 0(1)} 
2) DSPACE(S, .m,4) 


Cc DSPACE(S,). O 
By Proposition 6, one more corollary is implicit in Corollary 11. 


Corollary 12. If S, is fully constructable, then 
DSPACE(S,) - U {NSPACE(S, )| S,(n) ¢€ 0(8, (n)? + (log n)”)} 


contains a language over {0,1}. 


Remark. The original arguments of [HU69a] and [SHL65] were for So 

merely constructable. For Sy constructable by an (m,4)-machine M with 
* 

L(M) CD , accordingly, a witness language over £ x {0,1} is obtained in 


each of the above results. 
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5. Padding whole languages 


For space bounds above log n, the separation results given by 
Corollary 11 are very good. For Sy fully constructable and 
log n € o(S,(n)), in fact, since So € 0(s,) implies DSPACE(S.) Cc 
DSPACE(S, ) (Proposition 3), it follows from Corollary 11 that 
DSPACE(S,) - DSPACE(S,) # @ if and only if S, ¢ 0(S,)- Corollary 12, on 
the other hand, is relatively weak and does not even separate NSPACE(n°“) 
on NSPACE(n”), for example. 

Using the padding trick of Ruby and P. Fischer [RF65], Ibarra [Ib72] 
has refined some of the separation results given by Corollary 12. The 
basic trick is illustrated by the following lemma, where we write p(L) 
for {x10"| Pa <a | x10*| = p(|x|)} when L c {0,1}" and p:N +N satisfies 


p(n) > n. 


Lemma 13. If p(n) >n is linear space honest and log n € O(S(n)), then 


p(L) € NSPACE(S) # L € NSPACE(S op). 


Proof. Every language accepted deterministically within space n can 
actually be recognized (cf., footnote on page 43) within space n [HU69a], 
so let M deterministically recognize {bin(k)#bin(f(k))| k € N} within 
space n. 

(a) Suppose M, accepts p(L) within space S. Design M, to operate 
as follows on input string x: 

1. Write down bin(|x|) and then compute according to the transi- 

tion rules of M successively on 
bin(|x|)#bin(0), bin(|x|)#bin(1), bin(|x|)#bin(2),... 


until bin(p(|x|)) is discovered. As p(n) 2 n, this can be 
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accomplished within space proportional to log p(|x|) € 
0(S(p¢|x|))). 
2. Compute according to the transition rules of My on input 
x10? (1 *| =|] -2, By hypothesis, this can be accomplished within 
space proportional to S(p(|x| )) in acceptance. 
Clearly, M, accepts L within space proportional to S op. 


(=) Suppose M, accepts L within space S(p(n)). Design M, to operate 


1 
as follows on input string x10"; 
1. Write down bin(|x|)#bin(|x|+1+k) and then compute according to 
the transition rules of M to determine whether |x10"|- = p(|x|). 
This can be accomplished within space proportional to 
log p(|x|) = log | x10*| € 0(8(| x10" )) in acceptance. 
2.- “XE | x10") = p(|x|), then compute according to the transition 
rules of M, on input x. By hypothesis, this can be accomplished 
within space S(p(|x|)) = s(|x10"| ) in acceptance. 


Clearly, M, accepts p(L) within space proportional to S. 1 


The following theorem shows how Lemma 13 is used to improve known 


separation results. The formulation is a variation of Ibarra's [1Ib/72]. 


Theorem 14. Let sets 8 of space bounds be given, with 


1? 52 
log n € O(S(n)) for every S € 81 U 85° Say Pp, (@) > N,..-, P,(@) >n are 


linear space honest functions with S oP yay € o(s, °P,) whenaver 


1 
lsic 4, 8, € $> So € 8: 
If L €() [NSPACE(S, oP,)| S, € 8} - U {NSPACE(S, oP,)| 5, € 8}; 


then p,(L) €/ {NSPACE(S,)| S, € 8,} ~ U {NSPACE(S,)| S, € 8,} for some i. 


Proof. For 1l<si< g, let 


cG.1) =U PSIAER GS 5 omg $ 5 Gilg} oss: SeHgiw Bart. fas 
e¢f,2) = () {MOPAR ep,)| Ss, me 


Suppose L €.664,2) £6 Bs. 


BULLY ioe Boe 


L € C€44E,1) +b CLE Beg cs 
Ef .ee-semerho howe elme fi gy sadtre 2 asqoone WN aecqcu. feo 
La eR anRBie: : ors gee TR cog re swell ss 


Lecen + GhheEh 


The main reepht: of, sie chapters Lemma a apnegm 1. 
evectfie amiga of UNA shah ree ni ARMOR EHO 
Chapter Teg of: this: themts. mae 
vas eamaal in cuss by: £3 . ) e 
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6. Program codes and recursion 


For precision, let us now choose an appropriate program coding for 
off-line TMs. With each off-line TM having input alphabet {0,1}, we 
associate a distinct program code from f0,1}°; and we do this in agree- 
ment with the easily-satisfied conditions listed below. We use the 
notation pee for the set of program codes for (m,#)-machines and Looe. 


for the set of all program codes. We denote by M, the off-line T™ with 


program code e. 


m,£ 


Condition 1. No program code is a prefix or suffix of another, and D.C 


is regular for each m, 4. 


Condition 2. For each fixed m, £, there is an (m,£) -machine Up (a "uni- 
versal simulator") with 
= m,£ 
L(U,) = fex| e € ea »xeE L(M,)}5 


m,£ 
sc ae, sc, + eer) ife€é Lees? 


where c. depends. only on e. Furthermore, U, has only one computation on 


0 
ex if M. is deterministic. 
Condition 3. There is a recursive function f:1, - > L, ‘ such that 
£04 + part for each m, £ and such that M deterministically 


p-c. p.c. f(e) 


writes e at the front of its worktape and thereafter acts according to 


the transition rules of M.- 


Most common instruction~by-instruction or state-by-state codings of off- 
line TM programs can be tailored to satisfy these conditions. The only 
trick is to design the universal simulator of Condition 2 so that one of 


the 2 2 1 simulating worktape heads carries with it and references an 
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appropriate version of the program code a. th ae 
low sae che. a peeet < bod aoaren bere 


GH oh SBE 


WOH GH Fe 


TP, 03 dasals tuge gravee #?. 


theoren  (recwesten thearen) of 


aw boas . PT. 


= “0 ose rehome 


b4 


oh 


vet) ~~ fa] ee € LAD}, vgumeh a .veboo apxadig iin ko gee ais 


ae, @) <c+%& 


baRuE 2D 28645 & ai abso mavaowq af! 


: ee Pe sual * ae 5 aemenanenaie if ia. ; a 
& -& git Soes rod 


Proof. Let U, be wae “eabvareat simulator of Canditia 
panera’, FL OA ab smadd. f.. ot ct eae 


te an in Conbicion 3, amd let a, be che pong 


be an (m,£)-machine that operates ag; fe 
and ¢ on its worktape: i Rg LE 


2s Commer tee wena ‘eat he: 
with h(0) = hee 8) = 


oe avisausox £ alo our 


3. Simalate?¥z FA on aye." ‘To do this, camét. 


03 


‘mamoey oF carry Kerte)} “qwound with ene oof the the worktafe hese” 


rf mo des 


— 
#3 


“ot” Up: the redundant syul : 
mark the ends of the string pre ask ty 


2 ymares wi Io janet old 
: ee be edd: 


(Of Bran Rt ‘is fa that mannan es = ee ee 


Let e)°= £(6,). ‘Tiida’ pp wemeatties R:* @ jebiied ea 26: 
a 
itp Sib Io sotaiumbe Peavavi 


4 on the worktape. 


“4. Wette e 


ss Po see eed sive Bele cee Bete Vege a 
ede TIPPER S ei 44 ah OOF Dot Ph: Bae) SABRES Bs... 


in © Z 
3 SOW Fekesh 
SPRL cor Seal) Ter 


ee ete = .. gs 


ei CP oe fy 


@, to ‘Hintgesatare, 


a8 S AGS 


_? 


eee a 


Lie 
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2. Convert e, to f(e,) =e 


1 0° 
3. Convert eo to h(e,)- 
4. Simulate Up on €,€5x- 
Thus, 


x € re? @ €5€5x € L(U5) 


@ e,x € L(M), 


Space, (x) sc + Space, (ex) » 
e 
0 


where c is c, plus the number of worktape squares required for steps 1, 
2 


2,3. 0 
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7. Another general separation result 
The general separation result that we prove in this section (Theo- 
rem 18) amounts to a dramatic refinement of the following very weak 


"separation" result. 


Lemma 16. For no recursive space bound $ does NSPACE(S) contain all the 


recursive languages over {1}. 


Proof. If S is recursive, then the diagonal language 
{1"| 1" €L,@1,), le = bin(n)} 


is a recursive language not in NSPACE(S). © 
One more technical Lemma is all we need for the proof of Theorem 18. 


Lemma 17. If S/2 is fully constructable by a (2,1)-machine, then some 
deterministic (m,£)-machine recognizes 
t= {10%} k= m®).s¢5)4-y 


within space log. n- (4-1) log. log n. 


Proof. It is easier to get an (m,£+1)-machine that does the job. Given 


a fixed position s of the extra head, we can use the other £ heads within 


ft cycles of an m-ary counter that counts up 


to mn’, while checking whether k < in*sa*?, By trying successive posi- 


£-1 


space s to count through s 


tions s, we can find position 8p? the least s 2 1 with k< mes 

Certainly S is fully constructable by a (2,1)-machine. Since m2 2 
and £ 2 1, we can Leave the extra head at position ay and try to lay out 
space S(j) without reaching that position. We succeed if and only if 
§(4) ye-1, 


kom °S(j 


Suppose n is so large that 
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(Log | n - (£-1)+1log log. ny) £1 > (log n) 2-1 jm, 
If 
89 >2+ log, n- (£-1) slog. log. n, 


then 


m “(s)-1) 1 >n=jtkek 


by substitution, contradicting the minimality of s Therefore, | 


0° 
Sy < 2+ log. n- (4-1) -log. log. n 
for all sufficiently large n, and the simple method of Proposition 2 
yields an (m,£+1)-machine that recognizes L within space 
log, n - (4-1) log, log | n. 
To get rid of the extra head, we make two observations. The ‘first 
is that the boundary head can be used in the first phase to run the m- 
ary counter without losing its place. The second is that the boundary 
head can be used even to lay out space S(j) in the second phase. The 
reason is that, since S/2 is fully constructable by a (2,1)-machine, S 
is fully constructable by a (2,1)-machine that leaves every other tape 
square redundant by always writing and reading aa rather than just a for 


every worktape symbol a. We can modify redundant tape squares to mark 


the head position and the ends of the used space. (1 


Theorem 18. If S, is fully constructable by an (m,#)-machine, then each 


2 
of the following set differences contains a language over {0,1}: 
NSPACE(S, »m,£+3) - U {NSPACE(S, sm, £+2)| 1eE 0(S,(n)-S, (nt1))}, 


DSPACE(S,,m,£+3) - U {DSPACE(S, ,m,£+2)| 1 € 0(S5(n)-S, (n+1))}. 


Proof. Let S, be fully constructable by an (m,%)-machine, and let U, be 


2 0 


: 7(411), Ly »o € NSPACE(S, 0,443), and sisal ered it ents be very 
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Hes oe ead eae Ls ged? 


com 
nearly the hardest lenguage in that 26 PARRA. thet 404). €: 
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log | | x0" - (£t1)+Log log. | xo" 
< log. |exo**1) bs 


< 8,(jexo"*) 


- (£41)+1og, log, | exo 
; 
worktape squares. 
3. If k 2 S'(|x|), then compute on input x according to the transi- 
tion rules of M. This requires no more than 
S(|x|) < log, S'(|x|) - (£#1)-log, log, s?(|x|) 
< log. k - (141) *log log, k 


< log. | exo *}) 


k+1 


- (ht) slog log. | exo) 


< S, (| exo \) 
worktape squares for x € L(M). 


4. If k <S'(|x|), then compute on input exo" 


according to the 
transition rules of Uy» committing the final 0 to finite-state 
memory. This requires no more than s,(jexo | ) worktape 
squares for acceptance. 


To summarize the behavior of M' on ex0", 


k 2 S'(|x|) = behave like M on x; 


k <S8'(|x|) = behave like U, on exo*? 
To summarize the timing for exo* € L(@M'), 
Space, , (ex0") < s,(jexo"*t y, 


Applying the recursion theorem (Theorem 15) to M', we get a program 
code eo for an (m,#+2)-machine that accepts 

Lm) = {x0"| e x0 €L(M')} c 10" 
within space 


Space, (xo*) <sct Space, , (e x0") 
e 
0 
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: fies 
for every k: (3 


xo* € LM, > exel. tol 88%RuUp! sqeINtos 
‘Proof Vat x e “ey ie 40° "teks © ia pov awes mold .t mip a <« ADE 


Oe nN 2 2 


gai Ned = ey ‘Fe OY a 
i ra |} 8 ie (ees ise 
for every n= [eon] ‘we'estabitsh the claim ctatn for x by induetion on 
pole(Iea) - ft gol 2 
running doy from k= 8° hel) bo B= 8, ie 


x @ ~ ¢ 
iehis and 
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(by induction hypothesis) 
= e xoKtt € L(M') 


(by choice of ey) 


k+] k+2 
= Space, , (e,x0 d< 8,( € 9x0 1) 
(by space usage of M'‘) 
k+l. k+1 
> “en + i ae (x0 1) s “en +c + Space, , (e,x0 ) 


0 
(by choice of e&o° c) 


k72 
< ey +c + S, (| egx0 iD) 
| ky). 
s 8, (| egx0 > 
(because x is so long) 


7 e 


k+l o 
pr E Ly (Ug) = 140) 


(by choice of Uy) 
= e,x0" € L(M') 


(because by definition M' behaves like U, in this case) 


1 


=> x0" € LM, ) 
0 


(by choice of ep): oO 


Finally, M. can be modified to use its finite-state control to re- 
0 


* 
ject padded inputs (those not members of {1} ) and to agree with M on 
short ones (those not sufficiently long for the claim) without using the 
worktape. This gives an off-line TM that accepts L = L(M) within space 
8, (lel 4+n+1). Because 
s,( el t+n+1) € 0(S, (| eg|+")) 


c 0¢ 2) S,{n')); 
n'<2n 
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8. Applications of the general separation results 


Our first application brings together Corollaries 9, 11, and 12 
with the related consequences of Theorem 18. It is the latter (part 
(iii) of Corollary 19) that subsume and improve on the specific results 


of [Ib72]. 


Corollary 19. Let S, be fully constructable. 
(i) If S,(n) € O(log n), then DSPACE(S,) ¢U {NSPACE(S,)| S, € 0(S,)}. 
(1i) DSPACE(S,) ¢£U {DSPACE(S,)]. Sy ¢ 0(s,)}, 
DSPACE(S,) ¢U {NSPACE(S, | S, € o(s,7)}. 
(iii) NSPACE(S,) ¢U {NSPACE(S,)| S,(nt1) € 0(S,(n))}, 
U {NSPACE(S, )| S, (ntl) € 0(S,(n)), s, (2) € o(S,(n))} S NSPACE(S,). . 
(In the case S,(n#1) € 0(S,(n)), note that S, (ntl) € 0(S,(n)) is 
implied by S, (2) € ofS, (n))-) 
' Furthermore, there are languages over {0,1} that bear witness to these 


facts. 


Proof. (i) This part is a slightly weakened form of Corollary 9. 
(ii) By Corollaries 9, 11, and 12, we can take languages 
L 0,1}" h 
Loo? Low? 10 < {0,1} such that 
Log € DSPACE(S,(n42)) - U {NSPACE(S, (n+2))| min{S,(n), log n} ¢ 
0(S, (n))}, 
Lo, € DSPACE(S, (n+2)) -U {DSPACE(S, (n+2))| So(n) € 
0(S, (2) + log n)}, 
Lig € DSPACE (S, (n+2)) -U {NSPACE(S, (n+2))| S,(n) 4 
2 2 
0(S, (2) + (log n)')}. 


Clearly the language 
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{00x| x € Loo} U {Olx| x € Loi} U {10x| x € Lio} | 
belongs to DSPACE(S, (n)) but not to 

U {NSPACE(S, (n))| min{S,(n), log n} € 0(S,(n))}, bE . 

U {DSPACE(S, (n))| S,(n) € 0(S,(m) + log n)}, or 

U {NSPACE(S, (n) | S(n) ¢ 0(8, (a)? + (log n)*)}. 

(Cf., Lemma 13.) It is easy to verify that . 
S, ¢ 0(S,) = min{S,(n), log n} € 0(S,(n)) Vv 
S,(n) ¢€ o(s, (a) + log n), 
S, € 0(s, 2, = min{S,(n), log . € o(s, ()) v 
“Sy(n) € 0(s, (n)” + (log n)”). 7 

(iii) Take m so large that S, is fully constructable by an (nm, f£)- 
machine. Theorem 18 saben a language over £0, De that bears witness to 
che nonconteinment in 

U {NSPACE(S,)| S, (n+l) € o(S)(a))} 

= (J [NSPACE(keS p™ | kEN, S tt) € (8, (n))} 

=U {NSPACE(S, ,m,3)| S,(n+1) € 0(S,(n))} 

cU {NSPACE(S, sm, 3)| 1eE 0(S, (n)-S, (nt1))} 

7) NSPACE(S, »m,4) 

Cc NSPACE(S,). 

Containment in the second assertion of part (111) holds by Proposi- 
tion 3. To prove that the containment is proper, appeal to the first 
assertion to get a language Lc {0, 1)" in 

NSPACE(S,(n+2)) - U {NSPACE(S, (n+1))| S,(nt1) € 0(S,(n)), 

S,(n) € 0(S,(n))} 
and then apply Theorem 14 with 
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8, = {5,| S, (at) € 0(S,(n)), 8, () € 0(8,(n))}, 
35 = {s,}, 
p,() =n +1, 


n+2. 0 


Pon) 
Examples. For any function G tending to infinity (1 € o(G(n))), however 
slowly, . _ 

NSPACE(1log n/c(n)) & NSPACE(1og n), 

' NSPACE((log n)“/¢(n)) g NSPAGCE((1log n)), 
NSPACE(n/G(n)) ¢ NSPACE(n“) , 
NSPACE(2"/G(n)) g NSPACE(2"), 

2 ont 

NSPACE(2° ) g NSPACE (2 )- 

Feldman and Owings [F073] have observed that deterministic linear 
bounded automata are more powerful than deterministic linear bounded 
automata with a fixed worktape alphabet; i. e., 

DSPACE(n,m) g DSPACE(n). 

Our next application generalizes that observation, showing, for example, 


that it holds even for nondeterministic linear bounded automata. 


Corollary 20. Let S be fully constructable. 

(i) If S(n) € o(log n), then NSPACE(S,m) DSPACE(S). 

(44) DSPACE(S,m) ¢ DSPACE(S). : 

(i111) If S(m+1) € O(S(n)) and 1 € o0(S(n)), then NSPACE(S ,m) g NSPACE(S). 
Furthermore, there are languages over {0,1} that bear witness to these 


facts. 


Proof. (i) Take m so large that S is fully constructable by an (m,1)- 


machine. By Propositiog:1,/ 84a) €ip(4og( tey.a)9 so(thebyém ‘6: gives a 
language over {0,1} that bears witness to the moenonteioment.id =.” 
NSPACE(S,m) c NSPACK(S wi, 1) 0 he iota 
 DGPACE(3+8 ,m+1,2) 8+ a= areg 


sea DSPACE (3)... of satires 2 goljonuk yas r63F -2elqua x8 
(44) Part @ handies the case S(n} € ofle 


S(n) € o(log nu). Take m so large rent rome 
(m,1)-machine and S{n) - log.‘9 € 0(1)., .¢qqymaliog, he ‘Pheores- 
a language over {0,1} that bears witness bg. ae coh ay 
DSPACE(S,m) C DSPACE(S ,wti ,1) \ (sy goaaan @ LAO ASAE 
# ipl an as . "Se soanan 2 Ceysnage- 
. C DEPAGR(S). ee 
ent ‘tthe ih''S6" tage “inde 'S is oRHEG Lebtide 
+ bodied caddy “eStwERSy ald te Hebi 
large that 1 € o(keS(a)-S(H#f)): 
that bears witness to the proper contatmem 
2 Gai tes aS es sid getoas° isd: eesiiszaneg sitesi loge pana oe) 
: seo Bibi BUH ajo mtesebaon sol nove ab len oi 


C MSPACK(S). OJesicctien0o yi fut ad 23ad Of urelfoteu 


3 fea th fF 
les. leg.’ WPS wadacelieg Gy, °° (ir goto a ames 
Seno G WSPACE(n)  (2)HOATEE 3 2 ba ByaOKIE! ELT) 
2 
— PY wii PY. ° Sf bas ((u)8)0 > (ireye at Cita) 
my fs 


Like oxped test fl, GO! yove asgaugeel S28 ars _sroerroditn 


“Thatta [Tb73a] has shown that DEEADS (i) pai saiaal 


—— a by ai a &.i)- 
OF Fe b eeiE es babauad 
_ i ds iy BI e {6° if® 


opens > te, mySOATed 


o 


ps 
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finite automata with k = 1 heads. ? The fact 

NSPACE (log, n, m) S NSPACE(log n) 
is just what is needed to establish a similar hierarchy theorem for 
NHEADS. To thia end, we prove a lemma relating NHEADS to NSPACE(log n) 


and DHEADS to DSPACE(log n). 


Lemma 21 (Ha72]. 
NHEADS(k) c NSPACE(1og, n, 2“, 1) c NHEADS(Kk+4), 


DHEADS(k) c DSPACE(log, n, 2", 1) ¢ DREADS(k+4). 


Proof. Let M be a two-way finite automaton with k heads. a 2*,1)- 
machine M' can simulate M by behaving like a "k-track" (2,1)-machine, 
using the respective tracks of its worktape to hold: the binary represen- - 
tations of the positions of the k heads of M. Clearly, M' is determi- 
nistic if M is. | | 


log, n 


bin(position of head 1) 


blankse ee 


— 


bin(position of head k) 


worktape head 
(at rest) 


Let M' be a (2* 1) -machine that accepts within space log,n. To 
simulate M', a two-way finite automaton M can encode each of the k 

ttwo-way finite automata with k heads can be described as off-line 
TMs that do not use their worktapes but that have k, two-way read-only 


input heads. We assume the k heads cannot detect each other, but nothing 
we say here actually depends on that convention... . 
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"tracks" of the worktape of M' as a head position whose binary represen- 
tation is the track contents. An additional head, head A, can keep count 
of the position of the worktape head of M'. 

To read the contents of track i of the worktape square M' scans, M 
begins by positioning head B coincident with head A and head C coinci- 
dent with the head whose poettion encodes the contents of track i.. 

(This requires help .from head. D since the heads cannot detect each other.) 
Then heads C and D are used to successively halve the position that en- 
codes track i (dropping remainders), while decrementing the position of © 
head B once for each halving. The renainder of the last division before 
B reaches the endmarker is the contents of track i of the worktane square 
scanned by M'. | | | 7 

To change the contents of track i of the worktape square M' scans, 
M begins by positioning head B coincident with head A and head C on the 
first input tape square. Then feuds Cenk 0 axe used to. successively 
double the position, while decrementing the gdetebod of head B once for 
each doubling. The position that is cecsed es B reaches the end- 
marker is the power of 2 which must be added or subtracted from the 


position encoding track i. 0 
Corollary 22. NHEADS(k) G NHEADS(k+2) . 


Proof. For each k, Corollary 20(4ii) guarantees the existence of some 
k' with | 
NHEADS (k) Cc NSPACE (log, n, re 1) 
g NSPACE (log. n, 2k" 1) 


C NHEADS (k'+4). 
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According to [Ib/73a] this is enough. 0 


Recently, Ibarra and Sahni ([Ib73b], [1IS73]} refined some specific 
instances of our Corollary 20 to show that a single additional worktape 
symbol sometimes helps. The following more directly proven corollary 
generalizes their results. Note that this is a case where the conse- 
quences of Theorem 18 are stronger than those of Theorem 10 for determi- 


nistic machines. 


Corollary 23. Let S be fully constructable. 
(1) If S(m) € o(log n), then 
DSPACE(S ,m) S DSPACE(S ,mt1,1) 
for all sufficiently large nm. 
(ii) If S(mt1)-S(n) € o(S(n)), then 
NSPACE(S ,m) g NSPACE(S ,m+1,1), 
DSPACE(S ,m)  DSPACE(S etl yt) 
for all sufficiently large m. (If S is actually linear space 
honest and log n € o(S(n)), then m = 2 is sufficiently large.) 
Furthermore, there are languages over {0,1} that bear witness to these 


facts. 


Proof. Take m so large that S is fully constructable by an (m,1)-machine. 
(If S is actually linear space honest and log n € o(S(n)), then m = 2 
will do, according to Proposition 7(ii).) Take rational numbers 64> 85 
with l< 6, < 85 < log (m+l). (Note then that 65° is fully construc- 
table by an (m,1)-machine, too.) 

(1) By Proposition 1, S(n) € o(log log n), so Theorem 8 gives a 


language over {0,1} that bears witness to the proper containment in 
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DSPACE (S,m) ¢ DSPACE(§, +S sms) 
G PSPAGK(S)+5.m,3) _ 
is GC RSPACR(S HN, 
GA) From s(atl)- S(n), € o(8(n)), and ro) .¢ OW), it is easy to show 
that 1 € 0(8(n)). and heace that 1 € sth 5 (n)-6* -5(n41)). Therefore, 
Theorem 18 gives a | language over {0,1}, that beara wimess to. the e proper 
containment in 
NSPACE(S,m) c NSPACE (64-8 om, 3) 
S NSPACE(S,+5.m,4) 
 NSPACK(S ,mti,1). 


The proof for DSPACE is identical. oo 


gtk | 


Examples; Within 5 of the space - beupde (hex, 2 a, ». all 
1/2 
slog log n, 2" , every additiqned ayarisnane .swahod inexnases the 


computing power of nondeterministic oad detemeinistic off-line TMs. 
Finally, ve go que step furtier and .shay that,edditional worktape 
heads sometimes increase computing powers .8 2... 


3.2 
n 


Corollary 24. Let $ be ‘futly constructapiee =: 
(4) If S(n) € o(log n), then | 
| DSPACE(S,mi8) G RABMER(S sm) 5 2 220: 7 
for all sufficteatly large jm.and alk hee: 0.500: 
(11) If SGrtl)-S(a) € O(log 6 (n)y and 1.€ o(8(a)), then 
NGRAGE(S.m,§) GMSPAGE(S ms) « | ee ’ 
DSPACE(S,m, 8) g DSPACE(S ,m) wily eh ae goons 
for all suffietently Lazgs a.and ali -4< (1f.8 4¢.actually linear 
space honest and log a € o(S(m)).s ‘then m.= 2 de qufficiently large.) 
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Furthermore, there are languages over {0,1} that bear witness to. these 


facts. 


Proof. Take m so large that S is fully constructable by an (m,1)-machine. 
(If S is actually linear space honest and log n € o(S(n)), then m = 2 
will do, according to Proposition 7(ii).) Look at any §. 
(i) By Proposition 1, S({n) @ o(log log n), so Theorem 8 gives a 
language over {0,1} that bears witness to the proper containment in 
DSPACE(S,m,£) c DSPACE(S - (1/2)+Log | S, m, £44) 
g DSPACE(S ,m, £+6) 
Cc DSPACE(S ,m). 
(Directly adapting the proof of Theorem 8 would give 
DSPACE(S ,m, £) G DSPACE(S ,m,£+3).) 
(ii) Take c >0 Ss Taven that S(nt1)-S(n) < celog, S(n). Since 
1 € o(S(n)), Theorem 18 gives a language over {0,1} that bears witness 
to the proper containment in 
NSPACE(S,m,£) C NSPACE(S - delog S, m, £+¢c]+4) 
g NSPACE(S, m, £+(cj+5) 
C NSPACE(S,m) , 
where c<d<_|[c/+l. (Note that j[c| = 0 if 
1 € O(1 - (S(n+1)-S(n)) /log $(n)).) The proof for DSPACE is 
identical. 0 


Examples. Within each of the space bounds (log, aye, ae, n, 


ne (log, ny?! every five additional worktape heads increase the comput- 
ing power of nondeterministic and deterministic off-line TMs. Some 


greater number of additional worktape heads increases computing power 


within space ne log, n. 
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9. Witness Languages over a one-letter alphabet 


The witness languages provided by the general separation results 
above are subsets of {0,1}". In this section we investigate conditions 
for the witness Languages to be subsets of. just Git; For sublogarithmic 
space bounds (Theorem 8), we know of no such conditions; but both 
Theorem 10 and Theorem 18.can be modified to give languages over just 
{1}. 

Theorem 25. If S, is fully constructable by an (m,£+2)-machine, then 
there is a language over {1} in 7 . 
DSPACE(S, ,m,£+3) - U {DSPACE(S, ,m,£)| 1 € 

0(S, (2) - 208, (n) - Le log, S, (n) - log. n)} 
Proof sketch. To adapt the proof of Theorem 10 and get ‘i diagonal lan- 
guage over just {1}, we aust, ia Limited space, somehow obtain a daserip~ 
tion of a (m,£) -machine és simulate on the out 1", Furthermore, each 
description must arise for infinitely many n. (We cannot.get by with. 
the condition of Theorem 10 because that would require each description 
to arise for a string of every sufficient length.) Because S,(n) 2 
log, n in the nontrivial case,;:a. suitable approach is to obtain the de- 
scription from the m-ary representation of the input length (e. g., by 


dropping the low-order 0's). © 


Theorem 26. Let f(n) € O(n) - O(1) be nondecreasing and linear space 
honest. If Ss, is fully constructable by an (m,£+2)-machine and 
log n € o(S,(n)), then each of the following set differences contains a 


language over {1}: 


88 


NSPACE(S, ,m, £46) - U {NSPACE(S, »m,£)| 
S,(n) - S,(n + £(n)) 2 4elog. n}, 
DSPACE(S, ,m,£+6) - U {DSPACE(S, »m, £) | 


S,(n) - S, (a + f(n)) 2 4elog. n}. 


Proof. Let £':N 4+ N be the strictly increasing function with range 
{n| f£(n) > f(n-1)}. Define injections g, h:{0,1}" 4 N. by 

bin(g(x)) = 1x, 

h(x0) = h(x) + f£(h{x)), 

heel) = £'(@@®@ =D) 4 BOD _ 4, 

h(Q) = £'(m) +m - 1. : — a Me os ds 
Use the fact that f(n) € O(n) to take j. so large that vee < jeh(x). 
Note that, because f-is linear space honest ond £(n) € O(n), the conver- 


h(x10*) 


sion of 1 to x10* (or, more conveniently, something like 


x1#bin(k)) can be accomplished within space proportional to log n. 


Claim 1. The result of this conversion requixes only space 
log, n - G(n) 
for some G with 1 € 0(G(n)). 
Proof. Because f is nondecreasing and unbounded, we can take some G, 
with 1 € 0(G,(n)) such that Hen tee j 
h(xl0") = h(x1) + keG, (k)+£(h(x1)) 
2 keG, (k) £(h(x1)) 
2 k+G, (k)- £(£* (@®OY)y) 
2 keG, (k) em), 
Therefore, 


log, h(x10*) > log, k + log, G,(k) + g(x1) 
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2 log, k + Gy(k) + |xl| + G,(|x1|) 
2 (log, k + |x1|) + c(n(xto')), 
where 


Gy (n) = log. G,(), 


G,(n) min{ g(x1)-|x1|| n = |x1|}, 

G(n) = min{G, (k)46,(|x1])| h(xt0") 2 n} 
all tend to infinity. The result of the conversion cro 180220") to x10* 
requires only space | x1] + log, k, so the claim follows. 0 


An additional worktape head can be used to separate xl from the m-ary 
representation of k, and additional space log | n can provide for an m- 
ary counter up to k. 

Let S, with log n € 0(S, (n)) be fully constructable by an (m,{+2)- 
machine, and let Up be the universal simulator of Condition 2 for m, £+2. 
Design an (m,+5)-machine U 
h(x) 


* 
9’ to operate as follows on input y € {1}: 


1. Find x with 1 = y if it exists. 


2. Compute on x according: to the transition rules of Up: 
By the considerations above, whenever step 2 alone uses more space than 
the conversion of step 1 (and ‘8,{h(x)) is enough space since log n € 
o(S(n))), the whole progranf‘can be carried out at the extra cost (over 
just step 2) of the three additional worktape heads (one to separate the 
parts of the representation of x, one to separate the entire (left- 
adjusted) representation from. the rest of the worktape, and one to scan 


the representation) plus 2elog h(x) - G(h(x)) worktape squares. By 


Proposition 7(iii), Lg (Uy) E NSPACE(S, .m, £46). We prove that 
2 


Lg (Uy') ¢ NSPACE(S, sm, £) for any space bound Sy with 
2 
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So(n) - S)(n + f(m)) = 4elog, a. 


Suppose the (m,£)-machine u,' accepts L. 30 within space Sy° 


where S 9 {n) - Ss 1 + f(n)) 2 4elog. n. Because log n € o(S,(n)), it is 
no loss of generality to assume also that S 1@) = log, 0 - To summarize 
the behavior of u,' F 

\y = ' ' 
LW") = Lg (Uy!) c L(y") 


and, for e € ne, 


2elog nex) 2 Ga(ex)) +e. + Spacey (x) < 5s ach(ex)), oo 


Spey 1 Mem) 5 s,(h(ex)). 


Finally, design an (m,§+2)-machine U, to operate as follows on. 


1 
input x € {0,1}°: 

1. Compute the m-ary representation: of: h(x). 

2. Similate U,' on 12) | mt O2 * 
If enough space (So (h(x))) is used, then the: extra ‘cost (over. just the 
computation by U,' directly on yh), is nq,a0re than 2+ log. h(x) work- 
tape squares (half for an m-ary representation of. h(x) and the other 
half for an m-ary counter up to h(x) to: Keep temack of the input head 
’ position on yh) plus the two additional:worktape heads. Hence, 
LU,) = {x| 1° €1@,"9} 

= {x| yh) 


c {x yO) ¢ L(U)')} 


€ bg (0p")5 


= L(Up); 
and, for every e € L adi 


2elog. h(ex) - eee + c. + Space, (x) < S, (h(ex)) = 
. e 
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PESeey Ae) s 2elog h(ex) + S, (h(ex)). 


* 
For any recursive L c {1} , we can use U, just as in the proof of 


Theorem 18 to get an (m,{#+2)-machine M. with 
0 


ae EL, if k = S'(|x|); 
e,x0* re L(U,), if k < s'({x|); 
sige 9 (xo*) <d+ 2-log h(e, aii 
“0 xo* € LM, ) 
“0 


xo" € L@, do 
0 


k-+1 
+S, (h(egx0")), if 


* 
. for some appropriate space bound S', some constant d, and every x € {1} . 


(This uses S, (a) 2 log, n.) 


. * 
Claim 2. For each sufficiently long string x € {1} , the following 
holds for every k: 
x0 ELM, ) ox EL. 
0 


* 
Proof. Let x € {1} be so long that 


G(n) 2 2-log jt c. +d 
0 


for every n 2 h(epx)- We establish the claim for x by induction on k 
running down from k 2 S'(|x|) to k = 0. 
kz s'(| x| ): 


xo" € LO, ) ex EL immediately. 
0 


k <s'({x]): Assume x0** Mem, Pa 


xo" € LM, ) = e,x0** recat ) 
“0 


k+1 
€ ee, 
> x EL. 


Se peso * € LO, ) 


SPS, ehice gah Pel °Rigeag, “ath 


7 Mu sina (8448 fe Jen &o @ 


at mao oT 


+d 


pe 2383205 sige 1S heyond BOBGE SILAGE TE HOR To. 


€Le } c Ly 

Bs k x anitle groi givmeicitive dora rot. -B mialo 
~ 0 € LM). 0 7 oe 

%5 34 Yisvs sae ablor 

If isa nondecreasing recursive foumcion op dyree chef. 5» = 


hy) < H({y|) for all y € {0,1)" . then Claim 2 gtves wpe Sortoving for 


sadd gaol oa ad. {{}) 3x fad tos: 


nade siacore es 


every sufficiently long = € L: 


nine as ha. Magn: + a,0ntegab) ia 
adiga: eis esd det idetes se &p ajd son crew TH 
sd + 2elog, § + 2plasy Biege, sabes AO Mean, 


< 8,(h(egx)) :Claj'e sa 


“ee 
ree 


efeS og fio 


od 


n'<H(2-|x| ye a 
It follows that L € MEPME( ¥°° 'Bj@x): ‘einel ts . ad re- 
pease 2'di(@ay ? 
4y.T 5 Foy ae 


cursive language over {1}, this contratseds Lemme 16. 
As in Theores 18, a siniler proof works weve : 
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Remark. The proof of Theorem 26 does not really require f£ to be linear 
space honest. It is enough to be able to compute f within space belong- 
ing to o(S,). If S, happens to be linear space honest, for example, 


f(n) = fon” S(n) will work. 


For the particular function f defined by f(n) = 2n, we can get a 


result that extends all the way down to O(log n). 


Theorem 27. Let S,(n) be fully constructable by a (2,)-machine, 
1eE o(S,(n) - log, n), £2 3. Then each of the following set differences 
contains a language over {1}: 

NSPACE(S, ,2,44+1) - U {NSPACE(S, ,2,£)| 1 € o(S,(n)-S, (2n))}, 


DSPACE(S,,2,$+1) - U {DSPACE(S, ,2,£)| 1 € 0(S,(n)-S, (2n))}. 


* 
Proof. Define an injection h:(0 + 1)°01(1'0') +N by 


h(e01x0%) = 2*.3).(64 +1), 


where 
x € {1}", 
Ix = bin(1), 
le = bin(4). 


h(e01x0") 


Note that, with care, conversion of 1 to (the reverse of) 


e01x0* can be accomplished within epace log, h(e01x0") by a -(2,3)-machine 
that Leaves a worktape head marking each end of the string; this will 
account for the requiegn: £2 3. 


Let Up be the universal simulator of Condition 2 oe 2, £- Design 


a (2,£)-machine U,' to simulate U, on the input ee , 1h (O1x0" ) when it 


0 0 


h(e01x0) 


receives the actual input 1 Because h(e01x0*) /n(o1x0) is an 
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, 


integer that depends only on e, this can be done at the extra cost of 
only qd. worktape squares, where a... depends only on e, whenever at least 
space log, h(e01x0") is used (so that e can. be computed from hfedix0 Dy: 


By Proposition 7(iii), Le (u") 3 NSPACE(S, »2,£+1) - We prove that 
2 
Le (U,'). ¢ NSPACE(S, »2,£) for any space bound Ss) with 1 € o(S, (n)-S, (2n)). 
2 
Suppose the (2, ¢)-machine u,' accepts L, Wy") within space Si> 
2 


where 1 € 0(S,(n)-S,(2n)). Because 1 € 0(S(n) - log, n), it is no loss 

of generality to assume S, (n) z log, n- To summarize the 

behavior of U,', 
L(U,") = Es (Up') © LM"? 

and, for e € we and x € {1}", | 
max{ log, n(e01x0), d, te, + Space, ((O1x0"), , < S$, (b(e01x0")) a? 


e 


Spacey «(IMO , < S,(h(e01x0")). 


Let Lc {1}" be any recursive language over {1}. Because L is: re- 
cursive, we can take a deterministic (2,1)-machine M that accepts L 
within some space bound S that is fully constructable by a (2,1)-machine. 
Design a (2,£)-machine M' that operates as follows on the input string 1": 

1. Use heads A, B, C to write down (the reverse of). e01x0* with 

x € {1}", h(e01x0") =n, if possible. This requires no more 


than log, h(e01x0") < s, (h(eo1x0 


)) worktape squares. 
2. Check that e € ut » and then erase all but x and oF. 


head A head B 
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Within the space occupied by x (for x sufficiently long), use 
heads A, B to compute a version of bin(|x|) that has every 

second and third tape square redundant. (Cf., proof of Lemma 
17.) As in the proofs of Proposition 4, Theorem 15, and Lemma 
17, one of these sets of redundant tape squares can be used to 
mark the two ends of the string so that it can be carried 

around and referenced by head A without confusion. The other 


set can be used as a binary counter up to |x| 


ae redundant bin(| x| ) blanks. 


head A head B 
Use head A in-an attempted full construction of space S(|x|) in 
the additional. space occupied by o*. All necessary input data 
can be obtained from the redundant version of bin(| x| ). There 


is success iff S(|x|) < k. 


- If S(|x|) < k, then use head A to erase the tape out to head B 


except for the redundant version of bin(|x}), and then compute 
as M would on the input x. This requires no more than 


S({[x|) + [x] <k + |x| 


< log, h(eo1x0**) 
+1 


< s, (h(e01x0" y) 


worktape squares. 
If S(|x|) > k, then completely erase the tape out to head B, 


freeing all % worktape heads, and then compute as Uy! would on 


h(e0d 1x0" 


+1 
the input 1 ) (which is just twice the length of the 
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+1 


actual input). This requires no more than s, (h(e01x0" y) 


worktape squares for acceptance. 


To summarize the behavior of M' on ph(e01x0") 


k = S(|x|) = behave like M on x; ' 
+1 


_k 
k < S(|x|) = behave Like u,' on 18(eOb0 ), 
For h(e01x0") € LMM"), 
space, ,(18(e0120"), : s, (aeotx0"*)y, 


The recursion theorem (Theorem 15) does not apply as stated, so we 
adapt it. Let 5 be the program code for M’.° Take M. to be a (2,£)- 


BOLO") (rere x € {1]*) on 


machine that operates as follows, given 1 
L 


ec, oF its worktape: . 


its input tape and e € i? 
1. Convert e to f(e), where f is as in Condition 3. — 
2. Convert: f(e) to the. string y € {1}" of length 3/, where 
bin(j) = 1ef(e). 


n(£(e)01x0")_ 


3. Simulate Uy on e,e1 To do this, commit e to 


finite-state memory and carry y around with one of the worktape 


heads of Up» modifying symbols of y to mark the ‘ends: of the 


string and the position in y that indicates which, if any, of 


h(£(e)01x0*) 


h(01x0") that compose 1 


the 34 copies of 1 Up is 


currently scanning on its input tape. 


Let ey = f(e,)- Then M, operates as follows on input ph(o1x0") where 


0 
x € f1}": 


1. Write e, on the worktape. 


2. Convert e to F(e,) = €- 
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* 
3. Convert e, to the string y € {1} of length 33, where 


—bin(j) = 


4. Simulate Up on oy o1(eg01x0"), 


Thus, 


{h(01x0") € Let, > ues 1h(ey o1x0*) € LU) 
hl, 01x0*) ais 


lee. h(e,01x0") 


Space, (1 
“0 
where c is c. plus the number of worktape squares required for steps 
2 


set Space,, (1 


1 .32,-9: 


* 
Claim. For each sufficiently long string x € {1} , the following holds 


for every k: 
k 
yh (OLx0 ) € LM@, )exe€ElL. 
0 


* 
Proof. Let x € {1} be so long that 


S,(n)-S, (2n) 2 40, + “ey +c 


for every n = h(e,01x). We establish the claim for x by induction on k 


running down from k 2 S(|x|) to k = 


k = S(|x|): 
jh(o1x0") : 104, 7 jh(e,01x0") € 100") 
ex € LQ = 
k <S(|x|): Assume yh(o1x0"**) ELM, R exe€é L. 


1h(01x0") ELM, ) = ihle, a0,” Lot") 
“0 
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k+l 
ey hak cee L(U,') c Ly") 


k+1 
on yh (Olx0 ) Ps LOM, ) 
0 


>x€EL. 


ke 

x € L =» yo(Olx0 Yeum, ) 

| S 

= phleg > € Lat’) 
e+, 

= Space,,(1"C%p°1*9 9) = 5, (h(e,o1x0")) 


k+1 


= max{ log. h(e,01 ME d. +c, + Space, (1 


+1 


< max{ log, h(e,01x0" )}; d te +c 


k+2 


Finally, M, can be modified to use its finite-state control to re- 
0 


ject padded inputs (those of even length) and to satisfy the claim for 


short ones without using the worktape. If le, = bin(j), then this gives 


61+1 


0 


an off-line TM that accepts {1 | x€L, 1x = bin(1)} within space 
8, (2 34.n(011")) € o(s,(3)-n(o11"))). From this it is easy to derive a 


fixed recursive space bound S3 for which L € NSPACE(S.). Since L is an 
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- arbitrary recursive language over {1}, this contradicts Lemma 16. 


As in Theorem 18, a similar proof works for DSPACE. [J 


Corollary 28. Let S,, S be fully constructable; and let f(n) € 0(n)-0(1) 
be nondecreasing and linear space honest. There are languages over {1}. 
that bear witness to the following proper containments: 

(i) U {DSPACE(S, )| 8, € o(S,)} S DSPACE(S,) » 

U {NSPACE(S, )| ar € o(S,)} S DSPACE(S,) 
whenever log n € o(s,{n)).* 

(41) U {NSPACE(S,)| S,(m + £(n)) € 0(S,(n)), S,(n) € 0(S,(m))} 

g NSPACE(S,) 
whenever log n € o(S,(n))- 

(111) U {NSPACE(S,)| S,(2n) € 0(S,(n)), S,(n) € 0(8,(n))} G NSPACE(S)), 
U {DSPACE(S, )| $, (2n) € 0(8,(n)), 8, (2) € 0(8,(m))} G DSPACE(S.) 
whenever 1 € 0(S,(n)). 

(iv) DSPACE(S,m) ¢ DSPACE(S) 

whenever 1 € o(S(n)). 
(v) NSPACE(S ,m) G NSPACE(S) 
whenever log n € 0(S(n)), 
S(n + f(n)) € 0(S(n)). 
(vi) NSPACE(S,m) g NSPACE(S) 
whenever 1 € 0(S(n)), | 
tthe technique of [MM71] can be used to show that each of the fol- 


lowing set differences contains a language over a one-letter alphabet if 
So is fully constructable: 


DSPACE(S,) - U {DSPACE(S, )| S, fully constructable, S, € 0(84)}; 
DSPACE(S,) - U {NSPACE(S,)| s, fully constructable, S, ¢Z o(s, ayy: 
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§(2n) € O(S(n)). 
(vii) NSPACE(S,m) G NSPACE(S ,m+1,1), 
DSPACE(S ,m) S DSPACE(S ,mtl ,1) 
whenever log n € o(S(n)), 
S(n + £(n)) - S(n) € 0(S(n)); 
m is sufficiently large. 
(If S is fully constructable by an (m,1) -machine, then m is suffi- 
ciently large; if S is actually linear. space honest, then m = 2 is 
sufficiently large.) . 
(viii) NSPACE(S,m) S NSPACE(S ,mrt1,1), 
DSPACE(S ,m) S DSPACE(S ,m+1 ,1) 
whenever 1 € 0(S(n)), 
S(2n)-S(m) € o(S(m)), 
m is sufficiently large. . 
(If S is fully constructable by an (m,1)-machine, then m is suffi- 
ciently large.) | 
(ix) NSPACE(S,m,£) S NSPACE(S,m) for all £, 
DSPACE(S ,m, £) S DSPACE(S,m) for all ¢ 
whenever log n € O(log S(n)), 
S(n + f(n)) - S(m) € O(log S(n)),. 
m is sufficiently large. 
(If S is fully constructable by an (m,1)-machine, then m is suffi-- 
ciently large; if S is actually linear space honest, then m = 2 is 
sufficiently large.) 


(x) NSPACE(§+S,2, 1) g NSPACE(§eS,2) for all £, 
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DSPACE(§°S,2, 2) G DSPACE (59352) for all £ 
whenever 1 € o0(S(n)), 
$(2n)-S(n) € O(log S(n)), 
§ is rational and sufficiently Large. 
(If §*S is fully constructable by a (2,1)-machine and 


1 € o(8eS(n) - log, n), then § is sufficiently large.) 


Proof. (i) Use Theorem 25. (See Corollary 19(ii).) 

(ii) Use Theorem 26. (See Corollary 19(iii).) 

(11i) Use Theorem 27. (See Corollary 19(iii).) 

(iv) Use Theorem 25. (See Corollary 20(ii).) 

(v) Use Theorem 26. (See Corollary 20(iii).) 

(wi) Use Theorem 27. (See Corollary 20(iii).) 

(wii) Use Theorem 26. (See Corollary 23(1).) 

(viii) Use Theorem 27. (See Corollary 23(i).) 

We explicitly prove parts (ix), (x) to show just how few additional 
worktape heads can increase the power to accept languages over a one- 
letter alphabet. ‘ 

(ix) Take m so large that S is fully constructable by an (m,1)- 
machine, and look at any ~. Take k so large that 

4elog. n + S(n + f(n)) - S(n) < ke log, S(n). 

Since S + kelog S is fully constructable by an (m,3)-machine, Theorem 
26 gives a language over {1} that bears witness to the proper contain- 
ment in 

NSPACE(S ,m, £) g NSPACE(S + ke log, S, m, £46) 


c NSPACE(S,m, £+k-+9) © 


(0 + £60) Be) Gad): gr: Bhtet $4 sas oS deGcakdons: 
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C NSPACK(Sgm)i: 0) 62.825) 90A02G 


wht 


The proof for DSPACE is identical. tfayae AI evar 


(x) Take rational 4 ssiaed eles amuse 


(2,1)-machine and §°8(n) ashes, B60 ARAN! CAML Look at | 
any £2 3. Take 6:> Guedvharge, ee Me 31) 
Since g¢S + ({ejtidateg, S3 hei Ve 
meconee 27 hret* mr er, ae 
containment in 
HSPACE(§°S,2,4) . 


( fearyet 


EfaeS +. (bh 


eT wip tL: 


265 mperoadT i:it 


soe aeroett gall fhe} 
$8.8 ponte; 


‘ Re 2m eet (754) 


; we —_ = ae tooxd 


ret ow 


reepectively. ~~ : ‘{tgdscaia se3tef 


- (18), Ab though VR CINDOS: BOSSODELY BFW: #9 ROAR 
we can exhibit a nonregulen: Langnage: 


fla) ninth} ods apt diwipibieby Rh 65) yoo egeugael 


A={n| £(m) ie « power of 2}. ee 7 A on 


(A. Meyer points out that, 3+; Hartuaniqe, a Bi ytd ont 5 
example in a private commmication techiey.n, Quenenpl 


. Language: 43 Lom {45} - 0 Guibas wWhematie? soitaau. wfind ai @ golet + 2 sonih 
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obtained from the deterministic off-line TM. that fully constructs the 
space bound of Proposition 7(iv), se L € DSPACE(log log n). To prove 
L nonregular, it certainly eutfices to find a positive integer n, for 
each prime p > 2, such that 

AN {men | L<em<p} =g#AN {men | 1 < nm}. 
Just take a, to be the least common multiple of the positive integers 


not exceeding 2x, where 2k <p< gk 


2k < £(aen.) <p< gett 


. For 1<mé< p,. then, 


so that ao ¢€ A. Yet, the least common multiple of the positive inte- 


+1 


gers smaller than 2k is a multiple of a, that does belong to A. 


Examples. There are languages over a one-letter alphabet that bear wigs 

‘ness to the following proper containments: 

NSPACE(2"/1og” n) ¢ NSPACE(2") (part (ii) with £(n) = log’ log. n). 

U {NSPACE(S)| S(n) € o(log n)} S NSPACE(log n) (minimum example of 
part (iii)). 

DSPACE (2" ,m) g DSPACE(2") (part (iv)) 


8.13 


NSPACE(n®"**/(10g, 9, n°, m) g NSPACE(n /(10B5 94 ayers: mt1, 1) 


(part (vii)). 
NSPACE((log, 5, 0)°"°, m) G NSPACE((Log, 9, n)?"°, mH, 1) 
(part (vii) or part (wiii)). 


n/ log” n n/log n 


NSPACE(2 > m) S NSPACE(2 » mtl, 1) (near-maximum 


* 
example of part (vii); f(n) = log log” n).. 


NSPACE(n!/8 


om, £) g NSPACE(n!/6 2m, £+| 46 | +10) for every rational § 2 1 
(proof of part (ix)). 


* * 
NSPACE(nelog., n/log n, m, £) S NSPACE (n+ log. n/log n, m, £+13) 


104 


(near-maximum example of part (ix)). 

NSPACE (log, n, 2k £) g NSPACE (log, n, 2X £+5) for every £2 3 
(proof of part (x)}. 
k 

NSPACE( (log, n) (log, log, n), 2, £) g NSPACE( (log, n) (log, log, n), 


2k £16) for every £ 2 3 (near-maximm example of part (x)). 


Corollary 29. Each of the following set differences contains a language 
over a one-letter alphabet: 
NHEADS (k-+5) - NHEADS(k), 


DHEADS (k+5) ‘- DHEADS(k). 


Proof. Corollary 28 gives a ‘language over {1} that bears witnane to the 
proper containment in 
NHEADS(k) c NSPACE(log, n, 2“, 1) (by Lenma 21) 
ri NSPACE(log, n, 2", 6) 
eH 1) 


C NHEADS(k+5) (by Leama 21). 


C NSPACE(log,, n, 2 


The argument for DHEADS is identical. 0 
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10. Open questions 


Qur most general open questions, of course, concern necessary and 


sufficient conditions for containment and separation among the 


NSPACE(S ,m,£), DSPACE(S,m,£) complexity classes. 


1. 


For containment we ask in particular how close the truth comes to 


the "ideal" result 


S,(n) ] S, (a) If 
2 *S8y(n) 7 € o(m, + «8, (0) 4) = 


n 
NSPACE(S, sm, » £5) c DSPACE(S, »m, ,4,)- 

This very strong statement would immediately yield and perfect. all 
the results of Section 2. It would also yield NSPACE(S,m,£) = 
DSPACE(S,m,£), however, so it seems extremely likely that the truth 


stops somewhat short of the statement. 


For separation we ask how close the truth comes to the "ideal" result 
that, for So fully constructable, there must be a language in 
DSPACE(S, »m, £5) - U {NSPACE(S, »m, »£,)| 


S(n) by Ss) ky 
This very strong statement would immediately yield and perfect all 


the separation results of Section 4. 


Lemma 21 illustrates the relationship between additional input heads 
and additional space log n. If we consider a model that has k 2 1 
read-only heads on its input tape, then the open statements above 
| | S() s(n 4en® 


could be rephrased in terms of quantities of the form m 


rather than just mn?) ss (ny, Then they would include and perfect 
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also Lemma 21, Corollary 22, and the work of [Ib/72]. — 


The following specific instances of the above questions are just 


beyond the frontier of our knowledge: 


4. 


10. 


Il. 


DSPACE(n,2,1) = DSPACE(n/log, 3, 3, 1)? Proposition 3 comes close — 
to an affirmative answer. 
DSPACE(n,2,1) = DSPACE(n - log, 0, 2, 2)? Propositions 4, 5 come 
close to an affirmative answer. 

: 
NSPACE(log n) c DSPACE( (log n)*/1og n)? Proposition 6 comes close 
to an affirmative answer. 
NSPACE(S,m,£) = DSPACE(S,m,£)? Everybody expects a negative answer, 


but our study offers no clear and convincing evidence for one. A 


negative answer to any of open questions 8, 9, 10, 11, 19, 20 would 


do, though. 


DSPACE(log n) ¢ NSPACE ((log,, n)/2, 2, 1)? Theorem 8 comes close to 


an affirmative answer; e. g.,; DSPACE (log n) ¢ NSPACE((log, n)/3, 2, 1). 


DSPACE((log n) (log* n)) ¢ NSPACE(log n)? Corollary 19(1) comes 
close to an affirmative answer. 


on gntl mm 
NSPACE (2 ) g NSPACE(2 . flog un)? Corollary 19(iii) comes close 


to an affirmative answer, and Corollary 19(ii) gives an affirmative 


answer for the DSPACE analogue. 


* * 
NSPACE((log. n)", 2, 1) G NSPACE((1og n)")? Corollary 20(41i1) 
comes close to an affirmative answer, and Corollary 20(ii) gives 


an affirmative answer for the DSPACE analogue. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 
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DSPACE (log., n, 2, 1) Cc DHEADS(4)? Lemma 21 comes close to an 


affirmative answer. 
DHEADS (k) G DHEADS (k+1)? 


DHEADS (k+1) ¢ NHEADS(k)? For the particular case k = 2, we suspect 
k 
that f1"| kKEN, n= 2? } ¢ NHEADS(2), but the suspicion does not 


generalize. 


DSPACE (2™ ,m) ¢ DSPACE(2" ,m#1)? Corollaries 20, 23(ii) both come 


close to an affirmative answer. 


DSPACE (n(1og, 1) (log’ n), 2, 1) ¢ DSPACE(n(10g, 2) (log” n), 2)? 


Corollary 24(11) comes close to an affirmative answer. 


DSPACE(1og, a, 2, 1) g DSPACE(1og, n, 2, 5)? ‘The proof of Corollary 


24(ii) comes close to an affirmative answer. 


DSPACE(n - (log, ny 1/2 2, 4) g DSPACE(n,2,1)? 


gut 22 
Does NSPACE(2 ) - NSPACE(2” ) contain a language over a one- 


letter alphabet? Corollary 28(ii) comes close to an affirmative 


answer. 


Does NSPACE(2") - NSPACE(2”,2,1) contain a language over a one- 
letter alphabet? Corollary 28(v) comes close to an affirmative 


answer. 


Does DSPACE (ne log, n, 2) - DSPACE (n+ log, n, 2, 1) contain a language 
over a one-letter alphabet? Corollary 28(ix) comes close to an 


affirmative answer. 


Ho a a = pinennnienaneenll reat Ten 


22. 


23. 


24. 


25. 


26. 


27. 
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Does DSPACE( (log, a: 2) - DSPACE ( (log, a: 2, 1) contain a lan- 
guage over a one-letter alphabet? Corollary 28(x) comes close to 


an affirmative answer. 


Does DHEADS(k+2) - DHEADS(k) contain a language over a one-letter 
alphabet? 


Finally, we list a few miscellaneous open questions. 


Is there a hierarchy of languages over {1} for space bounds below 


log n? 


For S fully constructable by an (m,£)-machine and Up the universal 
simulator of Condition 2 for m, £, is there any language in 
NSPACE(S,m,£+1) that requires more space (on an (m,§+1)-machine) 


than the S-cutoff of Us? 


Even if L é€ NSPACE(S,) - NSPACE(S,), there may be an off-line ™ 
that accepts infinitely many strings x € L within space 8, (|x|). 
When can we find an infinite Language L € NSPACE(S.) such that 
every off-line TM that accepts L requires more than space 8, (|x|) 


on all but finitely many strings x € L? 


Is there some conceptually simple language in ) {NHEADS(k)| k= 1} 
or U {DHEADS(k)| k = 1} which is not in NHEADS(k) or DHEADS(k) for 
any small k (say k = 3)? If, for X a matrix of strings over {0,1}, 
we define 

r(X) = row-wise concatenation of X, 

c(X) = column-wise concatenation of X, 


then some good candidates are 


28. 
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{r(X)c(X)| X is ak x 2 matrix}, 

{r(X)ce(X)| X is a k x 2 matrix for some k}, 
{xr (X)c(X)| 
{x (X)c(X)| 


~ 


is ak y k matrix}, 


a 


is ak x k matrix for some k}. 


What are the complexities of these Languages? 


If S is fully constructable by an (m,%)-machine, does 
log. n - (A-1)-log log. n - S(n) € O(1) 
necessarily hold? Proposition 7(v) comes close to an affirmative 


answer. 


110 
BIBLIOGRAPHY 


inant). Aanderaa, S. 0., On k-tape versus (k-1)-tape real time computa- 
tion, SIAM-AMS Colloquia on Applied Mathematics, 7(1974), To 
appear. 


{AU72] Aho, A. V. and Ullman, J. D., The Theory of Parsing, Transla- 


tion, and Compiling; Volume I: Parsing, Prentice-Hall, 
Englewood Cliffs, N. J., 1972. 


{AU73] Aho, A. V. and cna J. D., The Satie of Parsing, Transla- 


tion, and Compiling; Volume II: ilin » Prentice-Hall, 
Englewood Cliffs, N. J., 1973. 


{[BG70] Book, R. V. and Greibach, S. A., Quasi-realtime languages, 
Mathematical Systems Theory, Vol. 4, No. 2, June 1970, pp. 
97-111. 


[BGIW70] Book, R. V., Greibach, S. A., Ibarra, 0. H. and Wegbreit, B., 
Tape-bounded Turing acceptors and principal AFLs, Journal of 


Computer and System Sciences, Vol. 4, No. 6, December 1970, 
pp- 622- 5. 

[BGW70] Book, R. V., Greibach, S. A. and Wegbreit, B., Time- and tape- 
bounded Turing acceptors and AFLs, Journal of Computer and 
System Sciences, Vol. 4, No. 6, pp. 606-621. 

{Bk72] Book, R. V., On languages accepted in polynomial time, The SIAM 

Journal on Computing, Vol. 1, No. 4, December 1972, pp. 281-207. 

[Blm67] Blum, M., A machine-independent theory of the complexity of 
recursive functions, Journal of the Association for Computin 
Machinery, Vol. 14, No. 2, April 1967, pp. 322-330. 

[Bor72] Borodin, A., Computational complexity and the existence of 
complexity gaps, Journal of the Association for Computin 
Machinery, Vol. 19, No. 1, January 1972, pp- isi 7h. 

{Ck71] Cook, S. A., The complexity of theorem-proving procedures, 
Proceedings of Third Annual ACM Symposium on Theory of Computing, 
Shaker Heights, Ohio, 1971, pp. 151-158. 

[Ck73] Cook, S. A., A hierarchy for nondeterministic time complexity, 


Journal of Computer and System Sciences, Vol. 7, No. 4, August 
1973, pp. 3-353. 


{Con72] Constable, R. L., The operator gap, Journal of the Association 


for Computing Machinery, Vol. 19, No. 1, January 1972, pp. 
175-183. 


[Con73] 


[F167] 


[FMR72] 


[F073] 


[FR74] 


[GB74] 


[Ha72] 


[HaS65] 


[HeS66 ] 


[HU69a] 


[HU69b] 


[Hun73] 


[Ib72] 


111 


Constable, R. L., Two types of hierarchy theorem for axiomatic 


complexity classes, in C utational C lexity, R. Rustin, ed., 
Algorithmics Press, New York, 1973, pp. BT-63. 


£ 


Floyd, R. W., Nondeterministic algorithms, Journal of the 
Association for Computing Machinery, Vol. 14, No. 4, October 
1967, pp. 630-644. ; 


Fischer, P. C., Meyer, A. R. and Rosenberg, A. L., Real-time 
simulation of multihead tape units, Journal of the Association 


for Computing Machinery, Vol. 19, No. 4%, October 1972, pp. 
590-607. 


Feldman, E. D. and Owings, J. C. Jr., A class of universal 
linear bounded automata, Information Sciences, Vol. 6, No. 2, 
April 1973, pp. 187-190. 


Fischer, M. J. and Rabin, M. O., Super-exponential complexity 

‘of Presburger arithmetic, Project MAC Technical Memorandum 43, 
Massachusetts Institute of Technology, February 1974. 

Gill, J. and Blum, M., On almost everywhere complex recursive 
functions, Journal of ie Association for Computing Machinery, 
Vol. 21, No. > July 197 > pp- or 3 . 

Hartmanis, J., On non-determinancy in simple computing devices, 
Acta Informatica, Vol. 1, Fasc. 4, 1972, pp. 336-344, 

Hartmanis, J. and Stearns, R. E., On the computational complexity 
of algorithms, Transactions of the American Mathematical Society, 
Vol. 117, May 1965, pp. 285-306. 

Hennie, F. C. and Stearns, R. E., Two-tape simulation of multi- 


tape Turing machines, Journal of the Association for Computin 
Machinery, Vol. 13, No. 4, October > Pp. ‘ 


Hoperoft, J. E. and Ullman, J. D., Some results on tape-bounded 
Turing machines, Journal of the Association for Computin 
Machinery, Vol. 16, No. 1, January 1969, pp. 168-177. 

Hopcroft, J. E. and Ullman, J. D., Formal Lan s and Their 
Relation to Automata, Addison-Wesley, Reading, Mass., 1969. 
Hunt, H. B. III, The equivalence problem for regular expressions 
with intersection is not polynomial in tape, Technical Report 


73-161, Department of Computer Science, Cornell University, 
March 1973. 


Ibarra, 0. H., A note concerning nondeterministic tape complexi- 


ties, Journal of the Association for Computing Machinery, Vol. 19, 


[Ib73a] 


[Ib73b] 


[IS73] 


[Krp72] 


[Lyn72] 


[Mey73] 


[MM71] 


[MS72] 


[NZ60] 


[RF65] 


[Rit6 3] 


[Rog67] 


112 


No. 4, October 1972, pp. 608-612. 


Ibarra, 0. H., On two-way multihead automata, Journal of 
Computer and § stem Sciences, Vol. 7, No. 1, February 1973, 
pp. 28-36. 


Ibarra, 0. H., A hierarchy theorem for polynomial-space recog- 
nition, Department of Computer Science, University of Minnesota, 
Minneapolis, October 1, 1973. 


Ibarra, 0. H. and Sahni, S. K., Hierarchies of Turing machines 
with restricted tape alphabet size, Department of Computer 
Science, University of Minnesota, Minneapolis, October 12, 1973. 


Karp, R. M., Reducibility among combinatorial problems, in 


Complexity of Computer Computations, R. E. Miller and J. W. 
Thatcher, ed., Plenum Press, New York, 1972, pp. 85-103. 


Lynch, N. A., Relativization of the theory of computational 
complexity, Project MAC Technical Report 99, Massachusetts 
Institute of Technology, Jume 1972.. 


Meyer, A. R., Weak monadic second order theory of successor is 
not elementary-recursive, Project MAC Technical Memorandum 38, 
Massachusetts Institute of Technology, December 1973. 


Meyer, A. R. and McCreight, E. M., Computationally complex and 
pseudo-random zero-one valued functions, in Theory of Machines 
and Computations, Z. Kohavi and A. Paz, ed.., Sener Press, 
New York, 1971, pp. 19-42. 


Meyer, A. R. and Stockmeyer, i: J., The equivalence problem 
for regular expressions with squaring requires exponential 


Niven, I. and Zuckerman, H. S., An Introduction to the Theory 
of Numbers, Wiley, New York, 1960. 


Ruby, S. and Fischer, P. C., Translational methods and computa- 
tional complexity, IEEE Conference Record Switching Circuit 


Theory and Logical Design, Ann Arbor, Michigan, 1965, pp. 173- 
178. ; Z 


Ritchie, R. W., Classes of predictably computable functions, 
Transactions of the American Mathematical Soc ety, Vol. 106, 
January 1963, pp. 1 9-173. 


Rogers, H. Jr., Theory. of Recursive Functions 
Computability, McGraw-Hi » New York, oa 


d ffective 


[Sav70] 


[SFM73] 


[SHL65] 


[M73] 


[St74] 


[Yam62 ] 


[Y¥ng71] 


113 


Savitch, W. J., Relationships between nondeterministic and de- 
terministic tape complexities, Journal of Computer and System 
Sciences, Vol. 4, No. 2, Aprit 1970, pp. -177-19 


Seiferas, J. I., Fischer, M. J. and Meyer, A. R., Refinements 
of the nondeterministic time and-space hierarchies, Proceedings 


of 14th Annual S osium on Switchin & Automata Theo » Lowa 
City, lowa, 1973, pp. 130-137. 


Stearns, R. E., Hartmanis, J. and Lewis, P. M. II, Hierarchies 
of memory limited computations, IEEE Conference Record on Switch- 


ing Circuit Theory and Logical Design, eeOOE Michigan, 65, 
pp- 179-190. ; 


Stockmeyer, L. J. and Meyer, A. R., Word problems requiring 
exponential time: preliminary report, Proceedings of Fifth 


Annual ACM Sympos tm on Theory of Computing , Austin, Texas, 
197 3 pp. —~Fe os : at ; ; 


Stockmeyer, L. J., The complexity of decision problems in 
automata theory and logic, Project MAC Technical Report 133, 
Massachusetts Institute of Technology, June 1974. 


Yamada, H., Real-time computation and recursive functions not 
real-time computable, IRE Transactions on. Electronic Computers, 
Vol. EC-11, No. 6, December 1962,° “D5 3- 


Young, P., Easy constructions in complexity theory: speed-up 
and gap theorems, Computer Science Department Technical Report 
57, Purdue University, July dda ’ 


114 


APPENDIX I 
TIME. DIAGONALIZATION. 


Diagonalization is a technique for conatructing a language that is 
not in some given class. If the members of the class can be described 
by character strings, then the simplest diagonal construction includes 
the string x just if the language described by that. atring does not in- 
clude x. A useful variant on this idea is to include xy iff the language 
described by its prefix.x does not. 

To diagonalize over a complexity class, a good approach is to de- 
scribe Vengunese by encoding the scourenk of the resource-hounded auto- 
mata that accept them. Then the construction, can be performed by em- 
ploying a "universal simulator" that can simulate any automaton from its 
program code. The simulation can then be examined, with disagreement in 
mind, to decide whether or not it leads to acceptance. 

Because we shall be interested also in an upper bound on the com- 
plexity of the diagonal language, we will want the construction to be 
effective and as efficient as possible. This calls for an efficient 
universal simulator. To diagonalize over DTIME(T), we can use the uni- 
versal simulation technique of Hennie and Stearns [HeS66] to simulate t 
steps of the deterministic TM acceptor with program code e by ciete log t 
steps of the simulator, where the constant c 2 depends only one. The 
diagonalization technique used by Hartmanis and Stearns [HaS65] then 
shows that DTIME(T,) - DTIME(T, ) is nonempty whenever Ty is a running 
time and Ty € oct, log T,)- For further detaile, see [HaS@5}, [HeS66], 


[Con73], and the sketch below of a nondeterministic diagonalization over 
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DTIME(T,)- 

For nondeterministic TM acceptors, we can use the technique of Book, 
Greibach, and Wegbreit [BGW70] (Lemma 8 of Chapter Two of this thesis) to 
get a more efficient universal simulation. (Doing so requires that their 
technique be effective, and it is.) In the following proposition, we use 
the details of this simulation in a diagonal construction in the style of 


[HaS65], [HeS66]. 


Proposition. If Ty is a running time with Ty 4 O(T,), then 


NTIME(T,) - DTIME(T,) # 6- 


Proof sketch. (We assume familiarity with the proof sketch in Chapter 
Two of Lemma 8.) We construct a TM acceptor M that diagonalizes over 
DTIME(T,) within time bound Ty: Given an input ex (with e a program 
code), M performs the (nondeterministic) Lemma 8 simulation of M, on ex 
and simultaneously operates clocks for the running times T,/2 and To: 
Recall that the simulation involves guessing a sequence of displays and 
actions and then checking it (deterministically) for one of three out- 
comes: 

not a legal computation, 

legal computation without acceptance, 

legal computation with acceptance. 
If the outcome is the second one and that fact is discovered after t 
steps by M, where T, (| ex| )/2 <t< T, (| ex|), then M accepts ex. There 
is no other way for M to accept. 

Now suppose M. deterministically accepts L(M) within time Ty for 


some particular program code e. Without loss of generality, assume that 
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M, halts only when it accepts. There is some constant c such that M 
will get through computations of length t by M. within cet of its own” 
steps. Since Ty ¢ o(T,), we can take x € {0,1}" so that 

e+T, (| ex|) < Ty (| ex| ) /2. Tf M, deterministically accepts ex, then it 
does so within T, (| ex|) steps, and there can be no longer legal computa- 
tion. By design, then, ex € LM.) implies ex ¢ L(M). If M. does not 
accept ex, then there is a legal computation of every length; therefore, 
ex ¢ LM.) implies ex € L(M). The contradiction establishes 


LM) ¢ DTIME(T,). O 


To diagonalize over NTIME(T) is more difficult. The problem is 
that discovering that M, does not accept ex within t steps seems to re- 
quire examining all legal lines of simulated computation up to t steps. 
This is 2 deterministic process which apparently may take exponentially 
longer than simulating a single legal line, so the diagonal construction 
yields DTIME(T,) - NTIME(T,) # @ whenever T, is a running time and 
log T, ¢ O(T,). 

None of the above diagonal constructions actually depends on Ty) 
and they all produce languages over {0,1}; so Theorem 1 of Chapter Two 
summarizes the results. 

A technicality rules out such strong separation results for lan- 
guages over a one-letter alphabet. Suppose, for example, that Ty isa 
running time with n log n € o(T, (n)) and that L € DTIME(T,) is a lan-. 
guage over just {1}. If the complement of L is finite, then Lis regu- 
lar and L € DTIME(n). If the complement of L is infinite, on the other 


hand, then our convention that only acceptance time matters guarantees 
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that LE DTIME(T, ) for 
T,(n), 1£ 1" EL; 

T,@) = n 
n, if 1 ¢@L. 

In either case, L €U {DTIME(T, )| T, ¢ o(T, log T,)}- 

Strengthening the "lim inf" condition on Ty (e. g, Ty 4 o(T, log T,)) 
to a "lim" condition (e. g., Ty log Ty € o{T,)) is one way to get. sepa- | 
ration results for languages over a one-letter alphabet... A diagonal 
language over {1} can then be constructed by trying to differ on input 
1” from Me (ny? where £(n) is obtained from, say, the binary representa- 
tion of the eceoneae of 2 in the prime factorization of n. The results 
are given by Theorem 2 of Chapter Two. 

As far as we know, diagonalization alone yields no results better 
than those of Theorems 1, 2 of Chapter Two for TM acceptance time com- 
plexity. If we change our definition to take into account the time 
spent in nonaccepting computations, however, then we can use the dia- 
gonal technique of [MM71] to get by with "lim inf" conditions in Theorem 
2. I. e., for 

NTIME'(T) = {L| L is accepted by some TM that never computes for 

more than T(n) steps on an input of length n}, 
DTIME'(T) = {L| L is accepted by some deterministic IM that never 
computes for more than T(n) steps on an input of 
length n}, 
the set differences 
DTIME'(T,) - U {DTIME'(T,)| Ty € O(T, log T,)}, 


NTIME'(T,) - U {DTIME'(T,)| T, € 0(1,)}, 


a 
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DTIME'(T,) - U {NTIME! (1,)| log T, ¢ 0(T,)} 


do contain languages over a one-letter alphabet if T, is a running time. 


2 
For T a running time, we clearly have 

NTIME(T) = NTIME'(T), 

DTIME(T) = DTIME'(T), 
so we do get languages over {1} in the set differences of Theorem 1 of 


Chapter Two if we insist that the unions range only over running times 


Ty: 
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APPENDIX II 


A PROGRAM CODING FOR CHAPTER TWO 


Let Le one [program], where 


[program] = begin program [instruction] end program — 
[instruction] = begin instruction [requirement] 

{rewrite] 

{shifts] 


{next] end instruction 


+ begin instruction accept end instruction 
[requirement] = begin requirement [symbo1]* end requirement 


{rewrite ] = begin rewrite [symbo1]* end rewrite 

[symbol ] = begin symbol tally" end_symbol 

[shifts] = begin shifts (left + right + sti11)* end shifts 
[next] = begin next [instruc. a0.) ond next . 


Pa ; 
[instruc. no.] = begin instruc. no. tally end instruc. no. 


begin program = 00001 end program = 00010 
begin instruction = 00011 end instruction = 00100 
begin requirement = 00101 end requirement = 0011C 
begin rewrite = 00111 end rewrite = 01000 
begin symbol = 01001 end symbol = 01010 
begin shifts = 01011 gad shifts = 01100 
begin next = 01101 end next = 01110 
begin instruc. no. = 01111 end instruc. no. = 10000 
accept = 10001 tally = 10010 


| = ree = 10100 
still =i1010F2 ees 1 ‘ 


e Yor ee leo. My is the T™ that 


|. "instruction" in ¢.— Bis berengs of sm insementon tote the. eet . 
f. lowing steps: amet ee 


isa@eilupen} modagutdenl sigel + faed: 


1. Deverntne vaether the emote tatng ssasned a the k capes 


laitawaz} 


2. . 


ZT 
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SOME MORE CORRECTIONS TO MAC TR-137 
Joel I. Seiferas 


December 30, 1974 


Pp. 9s Delete the six lines following the statement of Corollary 15. 


pp. 33-34: Delete starting with the fourth word of line 9 from the 


bottom of p. 33 through line 10 of p. 34. 


p. 35, line 14: 


p. 35, line 15: 


p- 35, lines 16, 


p. 35, line 22: 


Change "atts "1", 
Change "(1)" to "e(1) +2", | 
20: Change "f(n)im-1" to "£(n) m+". 


Change this line to 


"e(n) +e (a(n) = t(n) +n. 


<f(n) tn +1 
< (f(n) 41) + (n+#1) 
rl 
= (f(n)41) + ff (f(n)4),". 


p. 36: Delete the first three lines. 


p- 37, line 5: Change “Ty "to ag) ue 


